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This document contains the speaking notes, spoken comments, 
and prepared papers of the participants in a 1997 symposium on utilization of 
vocational education and training (VET) research in VET decision making in 
Australia. The document begins with the "Introduction" (Chris Selby Smith) . 
The next six sections contain the speaking notes and/or comments of the 
individuals who spoke at the symposium's first six sessions. The session 
titles and speakers were as follows: "The Users of Research: The Use of 
Research at State/Territory and National Levels- -VET Policy and Planning" 
(Nigel Smart, Perce Butterworth, Gregor Ramsey, Kareena Arthy, Robert Bluer) ; 
"The Users of Research: Use of Research by VET Providers for Improved 
Practice and Performance, and Policy and Planning at Provider Level" 

(Virginia Simmons, Brian Jones, Geoff Creek, Rod McDonald and Geof Hawke, 
Brian Conroy); "Research and Researchers' Perspectives: From the Viewpoint of 
VET Research Institutions" (John Owen, Chris Robinson, Geof Hawke, Gerald 
Burke, John Ainley) ; "Research and Researchers' Perspectives: From the 
Viewpoint of Other Sources of Research" (Robert Bluer, Don Anderson, Barry 
McGaw, Bruce Chapman, Terri Seddon, Fran Thorn); "Community Relations: 
Researchers' Contribution to Facilitating Interactions between Wider 
Economic, Political and Social Systems and VET" (David Corbett, Steve 
Balzary, Rex Hewett, Jane Carnegie, Shirley Randell) ; and "Research, Decision 
Making and Action in Other Functional Areas of Government, and 
Internationally" (Rod McDonald, Don Anderson, Chris Selby Smith, Peter 
Winsley, Russell Rumberger) . Sections 1-6 also include summaries of other 
matters raised in the discussion period. The final plenary discussion is 
summarized in section 7. Several presentations also include substantial 
bibliographies. Appended are the following: background paper on VET research 
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Editor’s 

Introduction 

Research and VET Decision-Making: February 1997 Symposium 

In April 1996, the Australian National Training Authority Research Advisory Council 
(ANTA RAC) advertised that it would fund a research project to ‘review the evidence 
for and where possible evaluate the extent of influence of research in vocational 
education and training. The Council stated that it was particularly interested in the 
impact of research in three areas: policy and planning; practice and performance; and 
community relations. The research consultancy was awarded to the Monash University- 
ACER Centre for the Economics of Education and Training (CEET), in association with 
the Research Centre for Vocational Education and Training (RCVET) at the University 
of Technology, Sydney. The authors were Chris Selby Smith (CEET), Geof Hawke and 
Rod McDonald (RCVET) and Joy Selby Smith (a private consultant). 

The research project was completed in December 1997 and, since ANTA RAC had by 
then been abolished, the report was submitted to the National Research and Evaluation 
Committee (NREC), a sub-committee of the National Centre for Vocational Education 
Research (NCVER) Board. NCVER has agreed to publish the project report as a book, 
Research and VET Decision-Making, during 1998. 

The research team, in investigating the question posed by ANTA RAC, employed five 
complementary approaches: a review of relevant literature; a symposium; quantitative 
studies; case studies; and reference to overseas experience. Chapter 3 in the report to 
NREC, and in the book being published by NCVER is concerned with the symposium 
which was held in Melbourne on 19-20 February 1997. The session summaries in that 
chapter drew out the issues relevant to the project as specified by ANTA RAC: they 
were not edited texts. Comments generally were not attributable, as the symposium had 
operated under Chatham House rules. 

Because of the valuable material contained in the symposium sessions and the interest 
expressed in the research project, it was suggested that the material be edited for 
publication promptly. Drafts were prepared from the original symposium material 
supplied by participants, supplemented where necessary from the tape recording of the 
symposium. Agreement for publication was sought from participants; and some speakers 
took the opportunity to fine tune their contribution. A brief record has also been included 
of points raised in the discussion periods which were additional to those included in the 
prepared presentations. 

It is a pleasure to acknowledge the valuable assistance provided by Sue Kent of East 
Melbourne Secretarial Services in preparing the papers for publication. 

People who wish to receive the CEET Newsletter or obtain further information on 
CEET activities should contact Mrs. Val Newson on Tel: 03.9905.9157, Fax: 
03.9905.9184 and e-mail <val.newson@education.monash.edu.au>. 



March 1998 



C.Selby Smith 



Introduction 



Chris Selby Smith 



Early in 1996 the ANTA 1 Research Advisory Council (ANTA RAC) advertised that it 
would fund a research project to ‘review the evidence for and where possible evaluate 
the extent of influence of research in vocational education and training’. The Council said 
it was particularly interested in the impact of research in three areas: policy and planning; 
practice and performance; and community relations. The motivation for setting up the 
study was not indicated in the brief. However, there have been suggestions that there 
was a degree of scepticism on the part of some stakeholders about the value of research 
and whether the money allocated to research was well spent. 2 

In the tender accepted by the funding body, the research team stated that ‘we know from 
studies of the use and impact of research both within education and in similar areas that 
the relationship between research and its outcome is almost always complex and not 
easily discerned ... (and that) ... it is important to note that we do not expect to detect 
easily the impact of particular pieces of research’. It was proposed therefore that the 
research question should be examined from a number of different perspectives. Five 
complementary approaches were to be employed: 

• a review of relevant literature, noting that there is no single approach to the issue of 
the impact of research, either generally, or specifically in vocational education and 
training; 

• a symposium, to identify key issues promptly and draw on different perspectives and 
approaches to the research question; 

• quantitative studies to provide information on the scope and nature of the impact of 
research on VET; 

• case studies, to explore the influence of the factors identified in the literature and in 
discussion at the symposium in the context of particular situations (the case studies 
provided a richness that could not be obtained from quantitative responses alone); and 

• a reference to overseas experience and perspectives, with a paper setting out 
preliminary findings to be circulated to inf ormed overseas commentators and their 
responses incorporated in the final report. 



1 Australian National Training Authority 

2 Later in 1996 the ANTA Board recognised the need for a more integrated research effort that would 

focus on providing advice to the wide range of VET stakeholders: the National Research and 
Evaluation Committee (NREC) was formed, as a sub-committee of the National Centre for 
Vocational Education Research (NCVER) Board, to ensure a more focussed approach to the national 
research and evaluation strategy. NCVER prepared for NREC The national research and evaluation 
strategy for vocational education and training in Australia 1997-2000 (NCVER, Adelaide^ 1997). A 
key component of the strategy is assuring that the best use is made of research and evaluation 
outcomes. 



The researchers also proposed, and the funding body accepted, that particular attention 
would be given to the impact of research on policy and planning, and practice and 
performance (referred to together as ‘decision-making’). Less attention would be given 
to community relations aspects. 

The research question as specified might seem to imply an uncomplicated, linear 
relationship between research and decision-making. In fact, the relationship cannot be so 
simply described. Research impact has been the subject of a number of studies in various 
areas of public policy. These studies have been carried out internationally and in 
Australia, including by members of the research team and symposium participants . 3 This 
accumulating knowledge brought us to a more sophisticated starting point . 4 

First, the idea of a one-to-one relationship between research and decision-making 
generally has been discredited. Rather, the perspectives that have been emphasised in the 
literature are that the larger impacts of research are more often indirect than direct; 
delayed rather than immediate; more minor individually but major in combination. 
Research involves the accumulation of knowledge, as discussion at the symposium 
emphasised. Research contributes to the ‘climate of opinion’ and the development of 
‘ideas in good currency’. Of course, these perspectives do not imply that individual 
studies necessarily have no impact. 

Secondly, the relationships between research and decision-making can be considered 
from two viewpoints: from that of research and from that of decision-making. The 
research viewpoint tends to narrow the perspective of the investigator to the research 
process and research outcomes (the ‘key hole’ problem) and downplay the complexity of 
decision-making. From the decision-making viewpoint the role of research is more 
diffuse, but not necessarily less influential. 

Thirdly, the literature identifies a number of roles for research but it is the information 
role that has attracted most study. It has been argued that research provides ‘new and 
better’ information, that it is more ‘rational’ information and that the quality and 
accuracy of knowledge based on research is better than that obtained from ‘reactive data 
gathering’. On the other hand, writers have also noted the ‘incomplete nature’ of much 
research based information from the decision-makers’ perspective: decision-makers can 
also draw on their own first-hand experience and many sources of direct information. 
The balanced view, it was argued, is to regard information derived from research as one 
of a number of sources of information available to decision-makers, and information 
from all sources as only one of a number of possible inputs into decision-making. ‘On a 
good day, ideas [information] may gain a hearing amidst the swirl of political 
considerations, but it must be a very good and rare day indeed when policy-makers take 



3 For further discussion see Chapter 2 in C. Selby Smith et. al., Research and VET Decision-Making, 

NCVER, Adelaide, 1998. 

4 It is of interest that while a number of Australian studies make assertions about the impact research 

does (or does not) have on decision-making in VET, few prior to this study have established the 
connections, either generally or in relation to particular instances. 
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their cues mainly from scientific knowledge about the state of the world they hope to 
change or protect.’ 5 

Fourthly, the strength of the linkages between research (and researchers) and decision- 
making (and decision-makers) also influences research impact. Contact between the two 
groups, not only at the close of a study, but also before and especially during its conduct, 
can have a strong influence on impact and can result in ‘the establishment of multiple 
areas of collaboration between the two parties which transcend the impact of a single 
study’. 6 From a wider perspective, linkages between research and decision-making may 
also be facilitated through particular institutional arrangements including the media, key 
stakeholder organisations and other interest groups, and mechanisms such as funding 
arrangements, so that linkages might be conceptualised better as a ‘web’ or ‘network’. 7 

These considerations led the research team to the view that to ‘review the evidence for 
and where possible evaluate the extent of influence of research on vocational education 
and training’ necessitated an understanding of the dynamics operating in each of the 
three areas: in decision-making; in research; and in the web of linkages. The organisation 
of the symposium had regard to this background. 

To develop a response to the research question also required that the meaning of the 
terms ANTA RAC employed, ‘impact’ and ‘influence’, be explored. In the consultancy 
brief ANTA RAC referred to the ‘impact’ of research on decision-making in the three 
areas of VET; their research question referred to ‘influence’. At the symposium and in 
discussions with those undertaking the case studies it became clear that the ways in 
which research can have impact are more wide-ranging than direct effects on decision- 
making alone. We took the term ‘impact’ and defined it to incorporate two elements: 
‘use’ and ‘influence’. ‘Use’ refers to whether the research has served a particular 
purpose. ‘Influence’ relates more closely to whether the research has had an effect on 
decision-making; that is, whether it has made a difference to the decision made. ‘Use’ 
can have several meanings depending upon the decision-making setting including: to 
solve a problem; to justify a prior decision; as a weapon in a political debate; and to 
improve conceptual understanding (see, for example, John Owen’s comments in Session 
3 of the symposium). 

The adoption of these meanings for impact, use and influence has a number of 
implications. First, it is implied that research can be used but not have an influence, in the 
sense of not making a difference to what would otherwise have been decided. Secondly, 
research can influence decisions not to act as well as decisions to act. To resolve not to 
act is as legitimate an outcome of decision-making as to resolve to act. Thirdly, whether 



5 Brown, L., “Knowledge and Power: Health Services Research as a Political Resource”, pp. 20-45 in E. 

Ginsberg (ed.), Health Services Research: Key to Health Policy, Harvard University Press, 
Massachusetts, 1991. 

6 Huberman, M., “Linkages Between Researchers and Practitioners - A Qualitative Study,” American 

Educational Research Journal, S limm er, Vol. 27, No. 2, pp. 363-391. 

7 Selby Smith, C., Davis, D., Fletcher, A., Fox, C., Ridoutt, L. and Selby Smith, J., National Health 

Labour Force Research Program, Graduate School of Management, Monash University, Melbourne, 
1992. 
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research is used or has influence may not be recognised. At the symposium, for example, 
some senior VET decision-makers who were known to be working on major policy 
issues where the ideas were derived from an accumulation of research-based knowledge, 
claimed that research had little or no impact on their work! 

Participants invited to the symposium were experienced and interested in the questions 
posed by the research study, including some who had been involved previously in impact 
studies. It was not possible to invite representatives from all of the Commonwealth, 
State and Territory Training Authorities to be present, even though it was recognised 
that there are significant differences in their history, culture and administrative 
arrangements. On the other hand, some participants had occupied a number of roles 
relevant to the Impact Project during their careers, for example, as policy-makers and 
later as researchers, or conversely. They were requested to draw on their diverse 
experience. 

The overall purpose of the symposium, which was held in Melbourne on 19-20 February 
1997, was to identify issues that could assist in understanding the relationships between 
research and VET decision-making. Understanding these relationships is necessary for 
‘[reviewing] the evidence for and where possible [evaluating] the extent of influence of 
research in vocational education and training’, the research question. Participants were 
asked primarily to address this purpose. 

It was also recognised that the broad parameters of the research study needed to be 
established early. Key terms required careful definition; in particular: ‘research’; the 
three areas of decision-making and action which were the focus of the funding body’s 
attention; and ‘impact’ of research. The research study needed to be bounded: 
geographically; with regard to the research time frame; and the constituents of VET 
research. Agreement was also required on the overall perspective of the project: that is, 
whether the relationships between research, and decision-making and action were to be 
considered chiefly from the perspective of research or from the perspective of decision- 
making. The research team had addressed these matters prior to the symposium and our 
views were set out in a paper distributed to all participants before the meeting. 
Participants were also invited to comment on this paper in the course of the symposium 
if they wished. (The paper is reproduced at Appendix 1.) 

The structure of the symposium was guided by the overall purpose of the Impact Project 
set down by the funding body. Sessions were set aside to consider the impact of 
research from users’ perspectives in each of the designated areas: at the State/Territory 
and national levels in VET policy and planning (Session 1); at the provider level, both in 
relation to policy and planning and for improved practice and performance (Session 2); 
and to facilitate interactions between the wider economic, political and societal systems 
and VET (that is, community relations: Session 5). Perspectives were also sought from 
researchers working in a range of research settings, including in VET research 
institutions (Session 3) and in other settings, such as private consultants, as expert 
advisers and in the formal inquiry process (Session 4). Similar studies have been 
undertaken in other areas of public policy, for example, in health and in other areas of 
education. Researchers from these areas reported on their findings in Session 6. 
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Presenters from the United States and New Zealand added an international perspective to 
this session. Some additional matters were raised in the plenary session which concluded 
the symposium. (The symposium program, including the list of presenters, is given at 
Appendix 2.) 

In the event, the symposium proved to be more fruitful than anticipated. Not only were 
many issues that could assist in understanding the relationships between research and 
VET decision-making identified: there were three additional outcomes. First, the 
symposium process was interactive, dynamic and cumulative: one of mutual learning for 
those prepared to put their cognitive maps in jeopardy. Secondly, it proved possible to 
develop from the symposium discussions a set of responses to the research question: 
considered views and material offered by participants; and views and evidence which 
enabled the research team to draw further conclusions relevant to the research question. 
Thirdly, the symposium discussions provided insights beyond the specific questions 
raised by ANTA RAC. In particular, these related to ways of improving the relationships 
between research and VET decision-making. 

In the book which is being published by the National Centre for Vocational Education 
Research section 5 of chapter 3 summarises the discussion from the individual sessions, 
while section 6 brings together the particular matters on which the research team’s 
thinking was advanced by the symposium (section 6 is reproduced at Appendix 3). The 
present volume presents the full range of views put forward by participants, in then- 
prepared material and in the symposium discussions, as far as possible in the words of the 
participants themselves. 




Session 1 The Users of Research: The Use of Research at State/Territory and 
National Levels - VET Policy and Planning. 

Nigel Smart 1 Speaking Notes 

We have four eminent speakers with wide experience to address this topic: Perce 
Butterworth (NSW); Gregor Ramsey (NSW, Commonwealth, ANTA RAC); Kareena 
Arthy (Australian National Training Authority: ANTA); and Robert Bluer (formerly of 
the National Board of Employment, Education and Training: NBEET). I have been 
asked to set an appropriate context and this is a significant challenge. I shall try to do it 
quickly by posing a handful of questions. 

VET is operating in a very dynamic and complex environment. So are most government 
services, including higher education, but my impression is that VET is more complex 
than higher education (and than many other areas which are undergoing change from 
government policy at the moment). 

This complexity in VET policy making and planning arises in large part from economic, 
government, employment, delivery, industry and other pressures. And these pressures 
apply in a system with many structures at both the State and Commonwealth levels, with 
myriads of committees and coordination arrangements. This tends to make life anything 
but plain. 

So my first question is: can research be responsive enough to this environment? 
Research is something that traditionally takes some time and requires a bit of thought; 
but if the policy and economic environment and the operating environment keep 
changing at a great rate how can research be made responsive, to enable the answers to 
come out in time for them to be relevant to the current policy debates (even more so if 
the policy initiatives keep changing rapidly)? 

My second question is: can research drive policy or is it always the servant of policy? 
Much research I have seen looks at whether the policy is working or seeks to fine-tune a 
policy. But how can research be developed so that it will actually drive the policy debate 
rather than merely follow it? 

My third question is: do researchers speak the same language as policy makers and 
planners? When one listens to researchers delivering papers at research conferences the 
language they are talking is quite different from that of the policy makers, particularly at 
the government level. There is a need to work out how we can improve our ability to 
communicate together: it is not only the researcher’s responsibility, but also that of the 
policy makers and planners. Furthermore, government policies may be made outside 
VET and applied to it: I note that this symposium does not include such government 
policy makers. 



1 General Manager, Strategic Planning and Research in the (Victorian) Office of Training and Further 
Education. 



My fourth question is: does the research have sufficient credibility to infl uence policy 
makers and planners? I think this is quite a critical question: for example, consider the 
case of Margaret Mead and the case of Cyril Byrt. In general, one has to ask, how 
equivocal is the answer that research often provides? 

My final question relates to the issue of what is research and how can we assess the 
impact that research has? In government, research can range from highly sophisticated 
research to production of a couple of charts to a directed consultancy. 



Session 1 The Users of Research: The Use of Research at State/Territory and 
National Levels - VET Policy and Planning. 

Perce Butterworth 1 Speaking Notes 



Where is the locus of research?: in Ministerial offices, at Commonwealth or State levels?; 
in the bureaucracy?; in outside bodies? There is very rapid change, which leads to 
changing agendas, set with very tight timeframes, and often set by political 
considerations (as in the case of MAATS, the Modem Australian Apprenticeship 
System). 

Ideally, we should have a policy and planning system which is research-based. This is 
not to say that that is the only base for policy and planning activities. Other factors 
which need to be considered include politics, practices, resources, culture, educational 
philosophies and ideologies, etc. 

When, however, we turn to our policy and planning activities, what do we find? My 
experience has been that, for most of the activities in which I am engaged, the cupboard 
has been relatively bare. Where is there evidence that researchers are contributing to the 
major debates? What recent significant planning and/or policy shifts can we point to that 
have been research-generated? Timeliness is a critical factor, so that answers come when 
you want them, rather than after the horse has bolted. 

There are many reasons for this scarcity, including: 

• different philosophical/ideological approaches to research; 

• structures and structural barriers to the use of research; 

• disjunctures between what researchers are researching and what planners and 
policy makers are working on; 

• the atomised nature of research in VET; 

• resourcing. This has improved, but the gains need to be defended; and 

• the lack of formal and informal links between research and planning and policy- 
making. We tend to have a research culture and a separate policy making culture: 
the bridge between them is pretty rickety and not nearly as strong as it might be. 

So as a user, how can I increase my use-rate of research? There are really two sides to 
this: 



• the product and its useability; and 

• the user and his/her ability to translate, integrate, etc., research into his/her work. 
This is one of the areas which is lacking. The people who use research, or who 
should be using it, often have only a passing knowledge of research techniques and 



1 Assistant Director-General, Strategic Planning, Resources, Research and Industry Networks, New 
South Wales Department of Training and Education Coordination. 




8 



16 



research methods. In the VET system there are relatively few people with a strong 
research background. 

Focussing on the product and its useability, it is difficult to deny that research reports are 
growing more user-friendly. Researchers must avoid, however, the temptation to report 
their results into the public domain via traditional dissemination processes only. I have 
often wondered what the user satisfaction rate is for many of the reports I have seen. I 
have never had a questionnaire come across my desk asking whether I am satisfied with 
the way research is going, as a customer: eg. how satisfied are the users?; what use is 
being made of the research? Otherwise, as the competition for funding becomes tougher 
there may be pressures to take the dollars away from research. Should our research 
come with an “after sales service” agreement, which enables a direct link between 
researcher and potential client? Dissemination may not be the total answer to this 
matter. 

Turning to the user and his/her ability to use research findings, I cannot help but note my 
ongoing frustration with, first of all, finding out what is actually in reports that might be 
useful and caveat-proof; and secondly, making sense of the results. For users to make 
sense of research reports and research results can be a major challenge. This is not to 
blacken all research, far from it. What is really important here is to recognise that users 
are busy people; are often looking for particular information rather than willing to wade 
through entire research projects; are not necessarily part of the “research culture” that 
drives much of our education systems; and are often not “research literate”. 

Apart from the above fundamental points, it is important to note that research is more 
than information provision. It is technical; it is judgmental; it is interpretive; and it 
sometimes proffers solutions. If researchers are worth their salt they are not just on 
about providing information. In some cases researchers are the most knowledgable 
people in the system; and have to take some responsibility for the judgments to be made. 

So how can I derive greater use from research? The answers are many and varied, but 
some of the more important ones for me are: 

• stronger ties between research and future directions and developments; 

• improved timeliness; 

• weeding out the “what it is necessary to know” from the “what it is nice to know”; 

• recognising that research is a system necessity; and 

• improved user-friendliness. 

These can be assisted by: 

• closer targeting of research funds to policy and planning issues; 

• improved linkages between research and policy and planning, via networks, 
secondments, etc.; 



• recognition that we live in rapidly changing times which require that research is 
short, punchy and focussed on its impact on the system; 

• better planning and leadership from the peak bodies so that we have a clearly 
articulated path of future development in which researchers can clearly see where 
their efforts fit; and 

• recognising that development is often an important outcome of research. 

In conclusion, the Australian VET system has never been in need of more sound research 
than it is at present. I do not think that our VET systems can go forward without a 
research base. We all need to lift our game if research is to support a more informed 
effort in policy and planning. 
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Session 1 The Users of Research: The Use of Research at State/Territory and 
National Levels - VET Policy and Planning. 

Gregor Ramsey 1 Speaking Notes 



Background to the Project 

The late Russell Linke, a member of ANT A RAC from the beginning, was a first class 
researcher, with a keen eye for research design. His own research had been directed 
mainly at policy and he was keen to see such an approach followed wherever possible 
with ANTA RAC research. His objective approach to research came through as a 
concern that decisions taken in vocational education and training may not have been 
based on the best research evidence available or even that research undertaken in the past 
may have not been sufficiently relevant to the concerns of decision makers. 

My own rather late entry into the VET field was marked with some surprise that it 
seemed slogan riddled, based on ideology rather than the best evidence available as to 
what was possible. Slogans such as industry driven, competency based, user pays, 
market driven, outcome focussed, learning on the job, all needed to be backed up by 
research as well as sound philosophical and theoretical writing. In particular, there was 
very little said about work, how it was changing, what it was for and how training for 
work and work itself could fit together. In addition, research in VET is a much lower 
proportion of total expenditure than in other sectors of eduction. 

Characteristics of good managers 

If research is to serve senior policy makers and managers, then it is important to know 
what such people are or should be like. They tend to: 

• be pro-active rather than reactive; 

• be solution driven rather than problem driven; 

• inculcate confidence rather than generate fear; 

• take responsibility rather than shirk it; 

• build trust rather than mistrust; 

• use their influence and power for good rather than flaunting it; 

• liberate the talents and abilities in others rather than stifling them; 

• be outward looking rather than inward looking; 

• lead acceptable change rather than resist it; and 

• keep up with their reading to assist their actions, rather than ‘winging it’. 



1 Partner, TASA International; and former chair of the Australian National Training Authority Research 
Advisory Council. 
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Researchers have to serve their needs. In the VET sector, senior policy advisers do not 
naturally read research, are extremely pressed for time, and are being driven by a rate of 
change seldom seen in other industry sectors, let alone in education. Also there is very 
little research available, much polemic and no history of success or even opportunity to 
base policy decisions on research findings. 

Characteristics of senior managers and researchers 

Senior managers/policy makers and researchers do not naturally form alliances and they 
have difficulty in talking to each other on equal terms, if at all. Very few policy 
administrators have been involved in research to know what researchable questions are. 
Nor have many of them had “hands on” experience of teaching or curriculum 
development. 

Because of the state by state legislative base for VET, too rarely are finding s on a matter 
in one state made available to all. Even more rarely are international finding s considered 
when policies are being developed, especially those from the non-English speaking 
world. 

The characteristics of researchers and senior managers are compared below. Given the 
differences in their characteristics and their roles it is not really surprising that they do 
not talk to each other very comfortably. 

Senior Manager Researcher 



• Broad knowledge base 

• Share resources fairly among competing 
demands 

• People centred 

• Pace of job externally determined 

• Multiple tasks competing for time - work 
done in short bursts 

• Institutional goal directed and focussed 

• Delegated authority 

• Listens 

Mind Set 



• Narrow, focussed knowledge base 

• Obtain maximum resources possible 
even at expense of others 

• Idea or experiment centred 

• Pace of job self determined 

• Engaged over long periods of time 
on a single task 

• Discipline or paradigm directed and 
focussed 

• Peer authority 

• Tells 



One of the big problems with people in policy making positions is their mindset! The 
mindset of people in VET is often very different from the mindset of people in other 
areas of education. People who are committed to a particular view of the world of VET 
find it difficult to break out and their mindset influences what policies are proposed and 
how they are implemented. Mindsets can act to cripple or to expand possibilities. 
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Two examples: the concept of IQ very much informs the educational mindset of school 
teachers and university lecturers. It is much less in evidence as a guiding principle in 
VET. The concepts of market forces and competition heavily influence economists who 
look for tangible bottom line outcomes. Mindset affects people in the way they: 

• see a problem; 

• define opportunities and threats in a competitive market; 

• assess strengths and weaknesses; 

• come up with solutions; 

• identify areas of priority; 

• make assumptions; 

• rationalise away problems and justify inaction; and 

• go about change. 

Principles of change in education and training 

New policy is essentially to bring about change. The greater the expected change and 
the smaller the timescale for the change then the more difficult it is to bring about. Nor 
can it always be expected that those involved in the change process are supportive, or 
even cognisant of its aims, nor can it be assumed that they have the skills required to 
implement it. A significant proportion of resources and effort is required to ensure that 
the people required to carry out the change are given the necessary knowledge, skills and 
team support to be effective. 

Policy makers are usually not responsible directly for implementing the change 
themselves. If a particular change begins to stall, or difficulties arise, the tendency of the 
policy maker is to blame those endeavouring to implement it, rather than to question 
either the policy itself, or the rate of change demanded. It will be interesting to see 
where “blame” will be placed if MAATS begins to stall. 

There are three important principles which should be applied when endeavouring to bring 
about change in VET: 

(i) Strategic: a desired end should be decided, and plans prepared to reach the goal. 
These strategies should be achievable, based on what is known. 

(ii) Sceptical: a critical appraisal should be made of principles underpinning the 
required change, the resources available to achieve it, and the evidence available 
that the planned change is likely to be successful. We do not see this sufficiently in 
vocational education and training. In fact, it is absolutely critical; but people do 
not like their pet theories being prodded. 



(iii) Collaborative: everyone involved in implementing the change must be 
knowledgeable about what is expected, have the skills to implement the change and 
be able to work in appropriate teams. 

Each of these principles requires sound research support. But beyond that there is need 
for a broad research culture in VET. An “educational impact statement” is critical to see 
whether the immediate benefits of the change are worth the resources, time and difficulty 
that so often accompanies them. 

Innovation that is not researched 

During times of change, the opportunity to change other things which may be peripheral 
to the main strategy is sometimes taken. These changes can take time and resources 
away from core business, and from the implementation of strategic plans. There are 
three kinds of innovation which can be counter productive, often because they provide 
no real gains and are not based on sound evidence, but rather on “it seemed like a good 
idea at the time”: 

(i) Multiple innovation: unresearched “good” ideas are undertaken in an 

uncoordinated way; new reforms are tried before previous ones have had time to 
take effect or be effectively evaluated. 

(ii) Innovation without change: attempts to respond to various problems or pseudo 
problems as identified, for example, by the press or industry, whether in relation to 
education and training specifically, or to the economy or society more generally. 

(iii) Change without innovation: there is plenty of action, but no improvement. 
Organisational structures are changed, authorities are abolished, financial 
arrangements are altered without any significant gains in student outcomes. 

Dissemination of research information 

The dissemination of research information is critical if it is to affect policy makers and 
those who influence directions for change. Processes whereby researchers and policy 
makers come together should be formalised, and researchers should see what they do as 
much in terms of the kind of information policy makers need as researching an interesting 
question. Much more effort is needed on behalf of, or by, researchers to ensure that all 
stakeholders of VET gain the maximum benefit from what they do. Much more effort is 
needed by, or on behalf of, policy makers to describe their information needs in 
researchable terms. Particularly, the facility to pose their needs in terms of questions that 
can be answered by research and those which cannot is essential. Some points relating to 
the dissemination of research information include: 

(i) the plan for the dissemination of research information is as important as the 
research methodology; 

(ii) the dissemination requirement should influence the funding of the research; 
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(iii) dissemination is a demand side rather than a supply side issue: that is, research 
information must be put in a form that can easily be handled by policy makers. 
Research is about providing something for people who need it. Often we try to 
solve the problem by changes on the supply side; 

(iv) policy makers, senior managers and researchers need an ongoing dialogue; 

(v) researchers need to make policy makers “hungry” for their findings; and 

(vi) policy makers need to make researchers “hungry” for the questions they need 
answered. 

Conclusion 

Research rarely gives simple answers because most of the questions that are posed are 
complex, often environment dependent, and not easily generalisable beyond the sample 
and circumstances in which they were undertaken. Policy makers have to sift through 
the information that is available, seeking trends, finding out what is likely to be effective 
and in the end making bold judgments from data which are too limited. 

Researchers on the other hand, particularly when they are independent of the policy 
makers, often point to flaws in policy, problems with implementation and unintended 
consequences that the policy makers would prefer not to hear. This is a creative tension, 
and it is a rare policy maker who can accept bad news as cheerfully as good and who can 
see this information as actually being more important in a policy sense than supportive 
research. 
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Session 1 The Users of Research: The Use of Research at State/Territory and 
National Levels - VET Policy and Planning. 

Kareena Arthy 1 Speaking Notes 



In an ideal world, research should be present at all stages of policy planning and 
development: 

• “good idea” phase - research triggers good ideas for future policy development; 

• “policy development” phase - policy development should be enhanced by 
input/testing/verification from research; and 

• “implementation” phase - policy should be reviewable/evaluated and results should 
inform further development or new ideas. 

There should be continual feedback loops between each of these phases. 

However, policy development that does benefit from this sort of input is rare. More 
often than not, policy is planned, developed and implemented without (or with very little) 
targeted/strategic input from VET research. 

So, in examining the impact of VET research it would be worthwhile to investigate the 
barriers to research effectively affecting policy. Such barriers include: 

• the timelines involved - policy timelines and research timelines are usually 
incompatible due to the relatively shorter term nature of policy development 
compared to research; 

• “policy maker blindness” - where policy makers either have a lack of knowledge of 
available research or have a lack of understanding of how the available research 
should be used. Many policy makers are not literate in research methods and the 
caveats which attach to research findings: this can lead to misreporting and to bad 
policy outcomes. 

• lack of research available. Generally, research has been reactive rather than pro- 
active: so, when making policy, it is often difficult to find relevant research which is 
available at that time. 

• confidentiality concerns / political nature of policy work. 

Each of these factors have direct and indirect impacts on how effective research is for 
policy, making it very difficult to isolate the impact of research on policy. 

In assessing the impact of research on policy from a policy maker’s perspective, there are 
essentially three elements to be considered: 



1 Kareena Arthy is Manager of the Co mmuni cations and Research Team at the Australian National 
Training Authority. As Kim B annik off was unable to attend the symposium at short notice, Kareena 
presented his paper. 




16 



24 



• how effective was the research in advancing the debate on policy (eg. by initiating 
new ideas, proving or disproving theorems: disproving can be very important); 

• how appropriate was the research (policy makers want practical solutions/options 
that are presented in an easy to understand format. They do not want to read through 
huge reports); and 

• how timely was the research (no matter how good the research is, if it is not timely, it 
may as well sit on a shelf). 

The next question is when in the policy cycle do you assess the impact of research on 
policy: 

• as policy maker uses each piece of research; 

• once policy is developed; 

• once policy is implemented; or 

• once the outcomes of the policy are seen? 

I suggest each of these stages is important, particularly that research you absorb in the 
initial stages of policy development. It may not be used until much later, if at all (it could 
be used even years later for another subject). 

It would be interesting to conduct a longitudinal study which maps the use of research in 
policy development - but the timelines involved in this project may not make it possible. 

Finally, I do not think that the impact of research on policy in VET can be separated 
from the impact of research on community relations (as implied in the ANTA RAC 
project brief). Research is to inform and policy cannot work if the right people are not 
informed. People are not going to accept the policy makers’ word blindly that a 
particular policy is “good for them” - they need to be convinced, which is where research 
comes in. “Community relations” is often the wheel that falls off in the whole policy 
cycle. Research can help rectify this and enable policy to be developed and implemented 
more smoothly. 
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Session 1 The Users of Research: The Use of Research at State/Territory and 
National Levels - VET Policy and Planning. 

Robert Bluer 1 Speaking Notes 

These brief comments seek to examine how some commissioned research undertaken to 
support advice from the Employment and Skills Formation Council (ESFC) of the 
National Board of Employment, Education and Training (NBEET) affected the policy 
report, its recommendations and the Commonwealth Government’s response. This 
perspective is from a policy advisory body rather than from a policy maker; and it is 
more difficult to judge impact or ultimate directions or outcomes. The Department 
provided advice to the Minister as a matter of course in relation to advice given by 
ESFC; generally it gave different advice to the Minister than the ESFC. 

Commissioned research (and any other available research relevant to the question being 
asked) is only one factor impacting on policy advice (see below): others, such as the 
views of the Department (DEET) or the extant policy or policies of the government, are 
extremely important influences on the final stage of policy advice. 

At the same time the views of the Council members and their own constituencies and the 
influences exerted on the policy development process from the relevant communities 
were also important. The Council included a number of contending forces. Broader 
community views were sought by consultations and in other ways. 

My own view is that commissioned research may be the least important influence on 
most occasions. 




1 Consultant in education and tr aining . From 1988 to 1995 he was Counsellor to the National Board of 
Employment, Education and Training. 
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For the purposes of illustration I will take three reports representing policy advice from 
the ESFC and their associated commissioned research. These are listed below. 

Reports of Employment and Skills Formation Council. 

1 . Raising the Standard: Middle Level Skills in the Australian Workforce (1993) 
Commissioned Research 

(i) Towers Perrin, Industry Profiles: A Stocktake of Advanced Vocational and 
Technical (Middle Level) Competencies in Eight Industries (April, 1993). 

(ii) Burke, G., Qualifications of Persons Aged 22 and 30: Approximate 
Estimates for 1992 and 2001 (August, 1993) 

2. The Shape of Things to Come: Small Business Employment and Skills (1994) 
Commissioned Research 

Sweeney & Associates, Small Business Index: special questions on small business 
employment, skills and staff training (February, 1994) 

3. Converging Technology, Work and Learning (1995) 

Commissioned Research 

(i) Rearck Research / TELEpartners International Technology Convergence and 
Future Skill Needs in Australian Industry to 2005 (June, 1995) 

(ii) Tinkler, D., Lepani, B., Mitchell, J. Education and Technology Convergence 
(June, 1995) 

It needs to be emphasised that the exercise here is concerned exclusively with attempting 
to assess the impact of the research on the final shape of the policy report, its 
recommendations and the government response. 



Research Input 


Impacts on: 


Policy Report 


Recommendations 


Government 

Response 


1 . Towers Perrin 


minor 


negligible 


nil 


1 . Burke 


major 


major 


nil 


2. Sweeney & 
Associates 


minor 


minor 


minor 


3. Rearck/ 
Telecentres 


minor 


negligible 


nil 


3. Tinkler et. al. 


major 


major 


nil 



In terms of the impact on the policy report itself the assessment from the above table is 
mixed. Both the Burke and Tinkler et. al. research were deemed to have had a major 
impact. This is to be expected; the fact that three of the five pieces of work had only a 
minor impact indicates either that the research did not answer the desired questions or 
answered them in a way which was difficult to use in a major fashion. 





It needs to be stressed that this outcome may have been the result of the ESFC either 
asking the wrong questions or asking them in a way which made them difficult to 
answer. 

The middle column in the table above indicates a link between impact on the policy 
report and impact on recommendations. Two pieces of commissioned research basically 
fall away to nothing, while the Burke and Tinkler work continues to show strong impact. 

The final column is the most problematic. While an initial government response may be 
negative, as in the majority of cases above, it is difficult to determine the time frame or 
even the context in order to make these judgments, particularly over the longer term and 
in relation to broad changes in community attitudes rather than immediate decisions by 
governments. 

For example, in relation to the 1995 technology report the Department and the 
Government were strongly negative in relation to proposals to spread computers in 
schools on a ratio basis. However, this did not deter them from going to the 1996 
election campaign with just such a policy. In another dimension this approach has been 
strongly promoted by almost all State Governments since the release of the report. 

This ratio approach arose directly from the commissioned research. This raises the issue 
of the timeframe over which the use or impact of research on decision making should be 
considered. 
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Session 1 The Users of Research: The Use of Research at State/Territory and 
National Levels - VET Policy and Planning. 

Other Matters Raised in the Discussion Period 



Matters additional to those identified by the five speakers which were raised in the 

discussion period included: 

• Prior research can be important in subsequent policy making, so long as decision 
makers are aware of it or have systems to check for it when required. In many cases, 
perhaps increasingly so, this appears not to be the case. 

• Researchers tend not to be entrepreneurial; and getting access to levels in a VET 
policy making organisation which are interested in research and can affect decision 
making may be difficult. There can be many gatekeepers and blockages, many 
agendas other than research. Researchers may not be very interested in undertaking 
these tasks, they may not be good at them and the institutions in which they work and 
seek to thrive may not always give high priority to dissemination of research 
compared to its conduct. 

• Are decision makers as keen to encourage research which is critical of established 
policies and practice as research which confirms or fine tunes them? In the long run 
research has a valuable role in critical examination of current practice and in 
presenting challenging alternatives to decision makers. 

• There was discussion about the time period over which the impact, if any, of research 
on decision making should be considered. It may be that the complete impact can 
only be determined in “the fullness of time” and that measures of immediate impact 
may be misleading. 
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Session 2 The Users of Research: Use of Research by VET Providers for 
Improved Practice and Performance, and Policy and Planning at 
Provider Level. 

Virginia Simmons 1 Speaking Notes 

Since the presenters will focus their remarks on the extent to which research influences 
VET providers in the pursuit of improved practice, performance, policy and planning at 
provider level, a useful way to put the issues into perspective might be to examine the 
range of major current influences on VET providers, regardless of whether or not they 
fall within the definition of ‘research’ as suggested in the background paper, and see 
where research ‘sits’ within this range of influences. 

To speak from the perspective of a TAFE Institute Director, the fundamental star ting 
point is that VET providers operate in a fiercely competitive market: internationally; 
between States in Australia; between providers locally; and between the public and 
private sector providers. They not only want to improve their practice and performance, 
but they want to be seen to be doing so by both their customers and by government, 
since this is a marketing edge and/or a means to attract additional resources in a climate 
where they are fighting for survival. 

The areas which most influence them in my view are: 

• State and national policy directions. This raises the question 'Are these policy 
directions influenced by research?’ as was discussed in the previous session. Here it 
is arguable that the point at which VET providers become most interested in research 
is the point at which it has already been translated, by whatever complex process, into 
policy. VET providers tend to be in a largely reactive situation. 

• State and national ITB’s and ITAB’s. They can have a substantial impact on 
providers. The same comment applies here as to the first point above. 

• ‘Best practice’ examples. Government is investing resources into establishing ‘best 
practice’ examples: performance indicators, targets and benchmarks; and budget 
guidelines. These are usually drawn from other providers and industry, consistent 
with the training market concept. They may include ‘models’ such as ISO 9001 
certification, the Australian Quality Awards (AQA) criteria or Investors in People. 

• Locally generated and locally specific research that VET providers undertake. These 
might include student characteristics; trend data and market research; or student, 
employer and staff surveys. In the training market this research often has commercial 
in confidence status; and it is never available for public use in a competitive training 
market. 

The above areas show a practical and pragmatic approach and partly reflect the reactive 
role providers are forced into in the current policy environment. Nonetheless, like good 
research, they can often also inform long-term policy and planning directions. 



1 Director, Kangan Institute of Technical and Further Education, Melbourne. 
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Session 2 The Users of Research: Use of Research by VET Providers for 
Improved Practice and Performance, and Policy and Planning at 
Provider Level. 

Brian Jones 1 Speaking Notes 



1. INTRODUCTION 

This paper presents two case studies of the use of research in vocational education and 
training as part of the ANTA RAC study on the links between research and policy, 
planning and performance in vocational education and training. These case studies are 
presented in point form rather than a written paper: readers interested in more detail or 
information should contact Brian Jones at Sydney Institute of Technology, telephone 
9217 4135 or email brian.jones@tafensw.edu.au 

2. CASE STUDY ONE 

The TAFE NSW Resource Allocation Model - a Case Study of the Use of Research at 
Sydney Institute of Technology. 

2.1 Background 

In November 1992 TAFE NSW initiated a project to develop a suitable model for 
allocating recurrent expenditure between the various TAFE NSW Institutes. It was a 
top down development. 

The resulting Resource Allocation Model (RAM) proposed that Institutes be allocated 
resources based on their volume of annual student contact hours (ASCH) and that the 
cost unit be expressed as SASCH. 

The main goals of RAM were based on: 

Efficiency: to be measured by cost per SCH 

Equity: measured by participation rates and SCH per target populations 

Budget: measured by meeting budgetary targets. 

Other goals targeted for future work were: 

Appropriateness: measured by ASCH per industry grouping 
Effectiveness: measured by $ per graduate ASCH. 

2.2 Initial Concerns at Sydney Institute of Technology in 1994 

Following the introduction of RAM in 1994, a number of concerns were expressed by 
Sydney Institute of Technology. Some of these concerns were: 



1 Faculty Director, Manufacturing / Personal and Community Services, Sydney Institute of Technology. 



• RAM was centrally driven by Corporate services at TAFE NSW in order to drive 
efficiencies into Institute operations; 

• RAM was perceived to be the introduction of a funding policy that would not allow 
for the identification of vocational education and training profile differences between 
Institutes, and also the “uniqueness” of Sydney Institute; and 

• the Institute had limited opportunity to challenge RAM because of the lack of local 
data and adequate information systems. We could not respond from the bottom up 
because we did not have the necessary data. 

2.3 Current Situation 

Funding from TAFE NSW to Sydney Institute of Technology continues to be influenced 
by RAM. The Institute continues to challenge certain aspects of the RAM methodology 
during funding allocation negotiations through the influence of our own research. The 
Institute is using the RAM approach in attempting to measure its own performance. 

2.4 Research Impact at Sydney Institute of Technology 1994-1997 

In terms of Institute practice and performance and the development of Institute policies 
and planning arrangements, continued research into the use of RAM has had a number of 
significant impacts. Some of these are: 

• there has been a change in Institute organisation culture with increased staff 
acceptance of the need to achieve greater efficiency and accountability in Institute 
operations; 

• more efficient systems for data collection, analysis and interpretation have been 
developed and are constantly being improved. This has been driven internally in 
response to the initial development of RAM centrally; 

• decision making and planning arrangements are more “transparent”. External sources 
of VET data collections eg., the Monash-Syntec economic appraisals, Australian 
Classification of Occupations (ASCO) are also used in the decision making and 
planning process; 

• the Institute now has work practices that encourage continuous research to measure 
its own performance. SASCH, for example, is now an accepted Institute performance 
measure used to measure efficient usage of resources; 

• any challenge to corporate TAFE is now based on fact. We think we are in a better 
position to go ahead from a research base; 

• new research areas are being explored concerning the impact of RAM on Institute 
practice and performance. As the training reform agenda develops over time we are 
better able to target particular areas to investigate in relation to Institute operations. 
Examples include the special needs of target groups, work based learning 
arrangements and science technician occupations; 
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• practically all research work is “in-house”. There is little evidence of any research 
involving RAM at the Institute level being used as research material for post-graduate 
degrees. There are considerable further opportunities to be exploited here; and 

• opportunities for research consultancies with external agencies have become available. 
2.5 References 

Australian National Training Authority, (1996). Annual Report Volume 3: 
Benchmarking Vocational Education and Training, Australian National Training 
Authority. 

Goozee, G., (1996). Devolved National Project on the Methods of Resource Allocation 
in Vocational Education and Training in Australia. Final Report. Methods of 
Resource Allocation in Vocational Education and Training in Australia, TAFE NSW. 

Planning and Evaluation Unit TAFE NSW, (1993). Resource Allocation Model: Report 
to Institute Directors Data, TAFE NSW. 

Planning and Evaluation Unit TAFE NSW, (1994). Resource Allocation Model: Issues, 
TAFE NSW. 

3. CASE STUDY 2 

The TAFE NSW Research Association - Case Study of VET Research in TAFE NSW. 

3.1 The TAFE NSW Research Association 

In 1993 the Sydney Institute of Technology formed a “Research Association”. This then 
expanded to the TAFE NSW Research Association in 1995. Membership of the current 
Association is open to all full-time and permanent part-time members of staff. No 
registration fees are involved. Initial seed funding of the TAFE NSW Research 
Association was by donations from the Directors of the various TAFE NSW Institutes. 

In terms of strategic planning, the vision of the Association is: “to be renowned for 
excellence and rigour in our research into vocational education and training, while the 
mission statement is: “ to encourage and enhance research by members into all aspects 
of vocational education and training. ” 

3.2 Activities of the Research Association 
3.2.1 Research Grants 

The purpose of the TAFE NSW Research Grants is to enhance and progress interest in 
research amongst TAFE NSW staff. The grants are a means whereby the Research 
Association promotes research activity in TAFE and supports research proposed by its 
members. 





For 1997 up to five grants of $1,000 will be available on a competitive basis to full-time 
and part-time permanent TAFE staff. These grants can be used: 

• to provide assistance in conducting investigations or inquiries into issues of relevance 
to vocational education and training; 

• to provide assistance for following up previous or exploratory research conducted at 
the local TAFE NSW Institute/OTEN/other TAFE unit level which is relevant to 
vocational education and training; and 

• to assist with research costs associated with the pursuit of formal studies which are 
relevant to vocational education and training and are career related or proposed for 
professional development purposes. 

3.2.2 Workshops and Annual Conference 

Workshops involving research-in-progress, research methodologies and guest speakers 
can be organised throughout the year. In April this year, for example, a research-in- 
progress workshop will be held at the Loftus campus of the Southern Sydney Institute. 

The December 1996 Annual Conference presented twenty-three papers. Details of these 
are included as Appendix 1 and are presented as the three major themes of the 
Conference: Identified Groups; Policy Research; cmd Teaching and Learning. 

3.3 Research Impact 

Since it began in 1994 the TAFE NSW Research Association has had a number of 
impacts at both the Institute and Corporate services levels. These include: 

• encouragement of an organisational culture where VET research is an accepted 
activity and where there is constructive attention to the links between research 
activities and policy, planning and performance; 

• the opportunity to disseminate results of research activities across the state wide 
TAFE NSW system and to other interested users; 

• an increase in formal VET research papers presented that are from research carried 
out at post-graduate level at a range of Universities. At the December 1996 
Conference some 6 to 8 papers were in this category (Masters or PhD level); 

• an expanding TAFE NSW “pool of expertise” in VET research with experience in a 
range of research methodologies across a wide spectrum of research interests; 

• variations of impact on policy, planning and performance. These range from no 
impact, despite good research, to immediate impact and improvement. The 
acceptance of research results is influenced by such things as political agendas, the 
economic climate, management strategies, attitudes and the timeframe of the research. 
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4. APPENDIX 1 - PAPERS PRESENTED AT THE TAPE NSW RESEARCH 
ASSOCIATION CONFERENCE, DECEMBER 1996 

4.1 Identified Groups - 6 Papers 

Anderson, T. Education Policy and Research Unit, and Cheung, K. Statistics Unit: 
Using TAFE NSW enrolment data to profile students in industry groups prior to 
conducting study research. 

Boote, J. Hunter Institute: Implementing Flexible Delivery for Students with 
Disabilities: Profits and Problems. 

Green, E. OTEN: Rural Youth Suicide: A Revisionist Perspective. 

Ingle, B. New England Institute: Review of JSS TAFE. 

MacColl, S. Education Development Division: No Matter How, No Matter Where - 
Recognition of Overseas Skills and Qualifications Project. 

Sim, C. Multicultural Education Unit: Training for Ethnic Small Business. 

4.2 Policy - 10 Papers 

Anderson, T. Education Policy and Research Unit and Scott, H. Policy Unit: Using 
Research to Assist Policy Implementation: A Case Study. 

Bartier, J. Foundation Studies Training Division, Baylis, P. Language Solutions and 
Horlyck, J. Classic Research: On the Job Curriculum Development and Delivery - What 
Does it Mean for TAFE and the Workplace ? 

Bolack, S. Illawarra Institute: What is This Thing Called MAATS? 

Coombe, W. Western Sydney Institute: Research Comfortable or Challenging. 

Gillezeau, A. Sydney Institute: Using a Research Tool for Teaching. 

Jenkins, H. International Services Unit: Perceptions of Ethical Issues in Establishing 
Workbased Teams in TAFE NSW. 

Manwarring, C. Sydney Institute: Researching Nurses ’ Competence - An Ethnographic 
Approach. 

Scott, H. Policy Unit, Corporate Services: Theorising the Policy of Vocational 
Education and Training - Where is the Policy Voice in a Devolved TAFE Structure? 

Williams, D. Sydney Institute, and Johnson, S. Sydney Institute: Student Selection 
Processes in TAFE - Analysis and Case Study. 
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Wyatt, D. Sydney Institute: Intelligent Systems Support for HRM. 

4.3 Teaching/Learning - 7 Papers 

Belme, J. Sydney Institute and Hart, P. TAFE Disabilities: Satisfied VET Customers, or 
are they? Inclusive Customer Satisfaction Measures for VET. 

Bourke, J. South Western Institute: Increasing Confidence and Independence in Formal 
Learning. 

Clemens, T. Sydney Institute and Garrood, S. Sydney Institute: Some Observations on 
Management and Small Business in New South Wales TAFE Programs. 

Ingle, B. New England Institute: An Integrated Approach to Flexible Delivery in Rural 
Australia. 

Lai , V. OTEN: An Innovative Model for Developing Flexible Learning Resources. 

Nyland, B. Dlawarra Institute: A Report on a Return to Industry Activity. 

Webb, G. Sydney Institute: A New Learning Environment for College-Based 
Programmes - Internet Based Training. 
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Session 2 The Users of Research: Use of Research by VET Providers for 
Improved Practice and Performance, and Policy and Planning at 
Provider Level. 

Geoff Creek 1 Speaking Notes 



1. SCIENTIFIC AND VET RESEARCH (YANCO Agricultural Institute 2 / 
Murrumbidgee College of Agriculture) 

• pure versus applied. Government funding is encouraging more applied research. 

• problem solving versus improvements in outputs. 

• production performance versus government policy. 

• market focus. Greater focus on real world problems. 

• industry uptake levels a function of: 

- degree of consultation 

- industry funding/ownership 

- cross disciplinary teams 

- industry leaders/innovators. 

• qualitative versus quantitative. 

• trend to contract research. 

• research design/methodologies. 

• reliability and replication of research. We need to be very careful about claims from 
people in ITAB’s that this or that is what industry wants. There is also an issue of 
how representative ITAB’s are: often successful business people do not have the time 
to be actively involved. 

• adaptation of overseas research. There is a research interpretation function: how to 
use (and often to adapt) overseas research for use in Australia. 

• integration of research with extensions/training to avoid isolation. 

• industry trials. 

• relevance to industry and institution. 

2. IMPLEMENTATION /DISSEMINATION OF RESULTS 

This is similar in relation to VET to our practice in agricultural research and extension. 
Perhaps there is not yet the same culture or tradition in VET; if so it needs to be 
addressed. 

• conferences / seminars / workshops 

- papers 



1 Principal of the Murrumbidgee College of Agriculture at Yanco, NSW. 

2 NSW centre of excellence for rice and horticulture. 
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- presentations 

- proceedings 

- staff development / reporting back. 

• journals / literature can be valuable. I have not found many Australian VET journals 
which are useful to me as a training manager. 

• staff exchanges / visits with proactive industries and providers. Important for the 
professional development of staff. 

• formal and informal networks can help to motivate staff and get them focussed. 

• collaborative research with other providers and industry. 

• case studies - publications 

- presentations / visits. 

• coursework / studies of staff enrolled at University. Opportunities for mutually 
beneficial cooperation. 

• field days - living displays of implementation. 

• media. 

• use of “second tier”. 

• varying levels of uptake - innovators versus followers. 

• institutional seminars - staff and industry 

- regional. 

• customer /client surveys - quality assurance. 

• national / international dissemination. 

• communication of results. Increasingly this is being recognised in the research 
context, eg. 

- low cost journals, videos, Internet, CD ROM 

- include requirement in contracts 

- reviews of national and international literature 

- monographs. 

3. RESEARCH PRIORITIES 

• pure versus applied (industry needs). 

• determined by funding bodies / client / customer. 

• improvements in efficiency and effectiveness of methodologies. 

• real world focus - industry versus institution (eg. workplace training). 

• extension / adult training / existing workforce. 

• use and development of technology. 

• new training technologies. 



- appropriateness 

- CD ROM / Internet 

- cost effectiveness. 

• evaluation / assessment methods. 

• training methodologies. 

• cost effectiveness of delivery. 

• costs of delivery. 

• preferred mode of delivery. 

• industry / market training needs 

- sector 

- enterprises 

- individual. 

• improved models for determining industry needs 

- reliability 

- quality 

- representative. 

• impacts of government policy, both NSW and Federal Government policies 

- access and equity, including for Aboriginal and Torres Strait Islander (ATSI) 
people and communities, where cultural sensitivity and research ethics are 
particularly important 

- economic development 

- environmental 

- small business. 

• need for cultural sensitivity / ethics of research. 

• state, national, international trends 

- eg workplace training, user choice, funding, labour market training. 

• resource allocation 

- human resources 

- curriculum and training materials development 

- capital works 

- information technology 

- management 

- effectiveness versus efficiency. 

• quality assurance. 

• distance education. 

4. PROFESSIONAL DEVELOPMENT OF STAFF 

• need for preservice and inservice training 

- improved training skills and methodologies 
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- to improve analytical and research skills. They are important for staff and for 
the institutions; for our culture, for promotion and for evaluation. 

• culture of lifelong learning for staff. 

• integration of graduate and post graduate students at institutions and in industry. 

• research fellows located with industry and institutions. 

• links to staff performance appraisals and progression 

- evidence of training in applied research 

- evidence of application of research findings 

- evidence of strong industry links and support. If not, they are unlikely to have 
support staff for their research or even resources for stores and travel. 

• cross discipline project teams. 

• collaborative arrangements between institutions in VET and in higher education, with 
industry, with funding bodies (eg. Cooperative Research Centres). 

• sourcing trained staff with professional research skills 

- particularly for rural / remote areas 

- internal versus outsourcing (retaining staff, expense / effectiveness of 
consultants) 

- developing staff with potential 

- training programs. 

• acknowledging staff - writing up their findings / results (lack of time). 

• research and development precinct. 



5. RESEARCH FUNDING 



• sources of funds. 

• research could be a component of all project budgets, not just delivery (cf scientific 
budgets). 

• project reports should include research findings, recommendations and 
implementation strategies. 

• rigorous research methodologies to be specified in contracts (cf quasi/pseudo research 
and data). 

• collaborative teams. 

• contract research. 
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Session 2 The Users of Research: Use of Research by VET Providers for 
Improved Practice and Performance, and Policy and Planning at 
Provider Level. 

Rod McDonald and Geof Hawke 1 Prepared Paper 

1. INTRODUCTION 

This paper attempts to draw together some lessons, from different perspectives, for 
research in workplace learning and assessment. Our conclusions are based on a variety of 
sources, including our own experience in policy forums, in working with practitioners of 
vocational education and training, and from our own involvement in VET research. 

2. POLICY PERSPECTIVES 

Any analysis of the effect of VET research on policy raises some very important and 
quite disturbing questions for people engaged in policy analysis, development and 
implementation. The main message is that research has played a very small role in 
informing policy developments over the past decade. Moreover, most of the research 
into workplace learning and assessment has been undertaken after the event — as a 
consequence of the policy decisions which placed so much importance on industry 
ownership and provision of vocational education and training (VET). 

Given that the reality of VET policy development has not followed the patterns and 
processes the liberal rational problem solving model leads us to expect, and given that 
research has not played a significant influence on recent policy developments, it is 
important to identify just what has limited the value of existing research to policy 
makers; what research information and product policy makers need; and what questions 
research needs to address and answer if it is to exercise greater influence in the future. 

The first point to make is that the answers to these question are dependent on the 
context in which they are asked. The type of research answers needed by policy makers 
during a period of stability and development within an established framework such as 
that which pertained during the decade from 1974 were different from the type of 
answers required during a period of fundamental change such as has existed since the 
mid-1980s. 

Given that a systematic VET research agenda was not developed during the former 
period this paper will focus on developments of the latter period, the present and possible 
future; and the concept of epistemological change throws light on the changes which 
were foisted onto a frequently resistant vocational education and training system. 
Analysis of major scientific changes, and, dare we say, analysis of major personal and 
organisational changes, provide an understanding of the elements which constitute a 
critical mass for change. Those include: 



1 Director and Senior Research Fellow, respectively, at The Research Centre for Vocational Education 
and Training, University of Technology, Sydney. 



• The if it isn't broken, don't fix it principle. For major change to take place there has to 
be a strong and prevailing belief that the existing paradigm, organisational structure or 
way of doing things is no longer capable of providing adequate responses to 
prevailing issues or of meeting systemic or organisational requirements. Without such 
a belief there will be institutional and individual resistance to change. The impetus for 
such a belief does not have to emerge from the paradigm or system itself. Rather it 
can be imposed on the system by unforeseen and profoundly troubling external 
factors. 

• The if there isn't an obviously better system or way of doing things, retain the present 
even if it is not perfect principle. Knowledge that the presently utilised paradigm 
system or present way of doing things is not capable of solving all problems is not in 
itself sufficient to spark a paradigm shift/systemic change. Rather, people, 
organisations and systems have to be convinced that there is a better alternative, and 
that it is very likely to produce more adequate solutions/outcomes. 

• The if the alternative system or way of doing things realistically is not achievable do 
not dispense with the present arrangements principle. Knowing that the existing 
paradigm or system is inadequate and knowing that a viable alternative exists are not 
sufficient to spark the epistemological shift if none of the players believe the 
alternative is available to them. It would be foolhardy to risk all in a major paradigm 
shift if the alternative is believed to be unattainable. 

Even if these three principles can be met, there is still no guarantee that change will 
occur. Without a sufficiently strategic and strong coalition of forces for change attempts 
to force change will be thwarted. Socio-economic and socio-cultural change is very 
uneven and marked by both coincidences of and conflicts in interest and purpose. If the 
forces for change cannot stitch together an adequate coalition, change will not occur. 
Even with a sufficient coalition, there will be resistance to the paradigm shift-resistance 
expressed in the full diversity of creativity available to those who remain committed to 
the existing system or way of doing things, no matter the basis of their position. 

We would argue that this is what has happened in relation to the reform of vocational 
education and training in Australia. 

What policy makers need 

What policy makers have needed in the past was not just an adequate research base, but 
researchers who were able to present their findings in ways relevant to the policy debates 
of the time. It is not sufficient to develop strong research and dissemination programs. 
Just as there is a significant time lag between the "discovery" of new scientific knowledge 
and its application in the form of new technologies/products, there is also an 
implementation lag in social scientific research and application processes. T his 
"translation" problem is compounded by the political imperative to respond to issues and 
to be seen to respond now and not later. Governments cannot declare a moratorium on 
policy development until appropriate research findings are available. 
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In summary, what policy makers needed then and need now is stronger and more 
critically attuned research and dissemination programs combined with a greater ability to 
translate research findings so that they can inform the strategic policy making processes. 

What has limited the value of research to policy makers? 

Perhaps the best approach to answering this question is to identify the elements which 
contributed to the push for a major systemic change in the organisation and delivery of 
VET in Australia. The national training reform agenda with all of its constitutive parts 
evolved or rather was constructed on a set of beliefs about the context and nature of the 
existing system. 

• The economic context of the future VET system: 

- we have to carve a competitive niche in an increasingly competitive global 
economy; 

- we have to reconstruct and develop our value adding manufacturing and 
services sectors; 

- we have to catch the high information technology wave; and 

- the best way to do this is to have an open economy and a highly skilled 
workforce. 

• The failings and inadequacies of the existing system: 

- it is controlled by bureaucrats and educationalists and is unresponsive to the 
needs of industry; 

- the curriculum is largely content based and unresponsive to industry 
requirements; 

- VET teachers tend not to have appropriate and recent hands-on workplace 
experience; and 

- it serves to protect skilled enclaves as opposed to facilitating articulation and 
skill transfer. 

• The existence of an available alternative mode of organising and providing VET 
which promises to more adequately meet the needs of a dynamic VET system in an 
open economy within a global market place. The features of the alternative system 
were identified in other countries and included: 

- industry ownership and control; 

- increased industry financial contributions and direct provision; 

- competency as opposed to content based curriculum; 

- work place delivery and assessment; and 

- skill recognition, transfer and articulation. 

• The construction of a strategic coalition of interests sufficient to put in place the 
reform agenda. 

In many ways the last feature was crucial and it was based on the many faceted nature of 
the rhetoric surrounding the reform agenda. In short it meant all things to all people: 

• For governments it promised greater industry financial contributions at a time of fiscal 
austerity, and in addition it was assumed capable of delivering industry relevance, a 
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more highly skilled workforce, all of the professed advantages of a competitive 
training market and, above all, international competitiveness. 

• For employers it held the promise of increased industry control and relevance of VET, 
reduced bureaucratic triple jumping, and the hope of custom made enterprise based 
modularised competency training, increased efficiency and productivity, increased 
profits, and so on 

• For unions it held the promise of a more highly / deeply / broadly competent 
workforce capable of earning high wages and capable of assuming increased 
responsibility on the shop floor, career paths for all workers, proper recognition of 
existing competencies, and the hope of fostering increased equity within the 
workforce. 

• For the women's movement it held the hope that, combined with award restructuring 
based on demonstrated competencies, the competency and workplace based system 
would facilitate the industrial pursuit of equal pay for work of equal value. 

• For the welfare sector, the national training reform agenda held the promise of an 
opportunity for greater equity, career paths, and the avoidance of a low skill / low 
wage future. 

In identifying these hopes and potential benefits it should be stressed that none of the 
parties involved in the process believed that their claim would unambiguously win out. 
All parties were sophisticated enough to identify the risks, but to proceed on the 
assumption that on balance it was possible to stitch together a loose coalition for change 
which would provide a positive sum outcome for all parties. 

It goes without saying that, on the whole, the arguments which held sway in the debate 
about VET policy were not based on well supported research findings about the efficacy 
of competency based and workplace training and assessment. Rather, they were 
grounded in research findings relating more directly to: 

• the nature and context of the Australian economy, to macro economic, industry and 
trade policy research; 

• the changing nature and organisation of work and industrial relations; and to 

• socio-economic equity and justice. 

The weight of analysis combined with a socio-political preference for a high-tech / high 
wage value adding response to the demands of globalisation to identify an “imperative” 
for a highly competent and flexible workforce. To the extent that the existing TAFE 
system could be seen not to be delivering these outcomes, and to the extent that there 
were international trends which promised their delivery, the relative lack of research 
findings on the efficacy of the training reform agenda was of scant regard. Moreover, 
there was plenty of hearsay evidence to the effect that the existing system was too 
bureaucratic, centralised, inflexible and incapable of meeting industry requirements. 

When thoughtfully combined and articulated these analyses and concerns held the 
promise of a VET system capable of producing a highly competent workforce and 



lighting the path to global competitiveness. The arguments were founded on a profound 
concern about the future viability of the Australian economy, and a well constructed 
scenario holding sufficient promise to a sufficient array of interest groups. Perhaps we 
should add a further criterion for an effective paradigm shift: 

• The a good story goes a long way in the right circumstances principle. 

Perhaps it was, and remains, a good (if exaggerated) story. 

3. PERSPECTIVES FROM PRACTICE 

In the Australian VET context, “practitioners” are a diverse group. For the purpose of 
this paper, the practitioners (whose interests research needs to serve) include industry 
trainers, HRD managers, TAFE teachers, government officials involved in funding 
education or training provision, and others who are responsible for providing education 
and training services to learners, to industry, to government agencies and to enterprises. 

What practitioners need 

In considering the contribution that research can make to practice it is useful to begin 
with a clear outline of what practitioners might, reasonably, ask of an effective VET 
system and, then, to consider what research might do to assist them in achieving those 
needs. Much research may take place in “a compound over there”, with little reference 
to what it might be used for. 

a. A consistent and reasonably stable context 

The environment within which VET practitioners are operating is one of significant and 
constant change. These changes have far exceeded the rate of change in the community 
more generally. For example, Hawke and McDonald (1995) identified twelve significant 
policy documents concerning just one area of the national VET system between 1992 
and 1995. Practitioners are confused as to what may be the policy this week, and 
frustrated by the need to constantly change their practice and documentation 

b. Clear and feasible rules and regulations 

In addition, much of current policy appears to have been driven by ideological, political 
and “religious” conviction rather than by any clear understanding of the needs and 
preferences of the various stakeholders in the VET system. Moreover, policy-makers are 
being required to work to timeframes which force decisions to be made without adequate 
reflection, and without the opportunity to test and refine their implementation. This is 
particularly manifest in the many attempts to define and prescribe regulatory 
arrangements. Practitioners have consistently defined these as unhelpful, impossible to 
implement in practice and unwieldy. One issue which has emerged in a number of 
research projects concerns the different views taken by States in the national training 
reform agenda which reflect more often the idiosyncratic views of individuals rather than 
different legitimate views the States might have. 
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c. Clear and useful guidance 

By the very nature of their role, practitioners are focused on the implementation of 
policies developed elsewhere and on translating these into effective and useful outcomes 
for learners and other clients of the system. Because of their background, their interests, 
the pressures on their time, competing priorities and a host of other causes, practitioners 
in general do not want to have to constantly re-invent the wheel. Their dominant interest 
is in providing the best possible service and, to do that, they want to know: 

• how best to carry out their responsibilities; 

• how to improve their existing practice; and 

• how to avoid making mistakes. 

d. Clear information on why various strategies work and/or are more effective than 

others. 

Practitioners are often characterised as wanting to know “what” but not “why”. In 
reality, however, practitioners want to understand the choices they need to make, and are 
commonly in the position of needing to adapt and modify their work to meet changing 
client needs and changing contexts. This requires an intelligent and informed 
understanding of the principles which shape their practice. 

Factors which have limited the value of VET research to practitioners 

a. Problems of currency 

The constant changes in policy and direction that have been experienced have made 
much recent research actually or apparently of little value. Frequently, research findings 
have only been formulated or disseminated after the policy or practice they sought to 
inform has been abandoned or significantly modified. 

b. Accessibility 

Too much of the research to date has been inaccessible to practitioners. This difficulty 
has two important dimensions: 

• a significant proportion of the research has been written in a language and form which 
is not meaningful to most practitioners; and 

• the findings of the great majority of research in the area have been published in places 
and ways which are not normally accessed by practitioners. In particular, one-off 
research reports have been the principal means of publishing research findings. These 
are difficult to locate, often out of print or otherwise not available. 

For academic researchers, academic journals and research reports are commonly used, 
but they are often not available to practitioners. Even where more “popular” magazines 
(such as Australian Training Review) have been used, these have limited circulation. 
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c. Credibility 



Practitioners want facts, not fashion, to be the basis of policy. Unfortunately, most 
practitioners recognise that a significant proportion of the recent Australian VET 
literature is better described, in Laurie Field’s words, as based on 'religious' beliefs. 

To date, the majority of Australian research on learning and assessment in the workplace 
has been simply descriptive of other people’s practice. Practitioners have not found in 
such research useful analysis of why some approaches work well under some 
circumstances, and others do not. 

In particular, too much “research” has been uncritically promotional, rather than critically 
evaluative. For example, as Docking has noted, practitioners are faced with a plethora of 
models all purporting to be the "true" or “best” interpretation of CBA. They need clearer 
information on choosing between competing models and, ultimately, better guidance on 
selecting and testing different approaches. 

d “Different strokes for different folks ” 

A recurring theme we have observed is the diversity of interests, needs and values which 
colour the development of research and policy and, subsequently, the extent of its 
usefulness to practitioners. Two particular facets of this are: 

• the wide diversity of understandings of the term "competence" and the difficulty of 
moving forward when, in effect, we are speaking different languages; and 

• the divergence in the needs and expectations of different groups of practitioners- 
exemplified, for example, by the fact that virtually every significant feature of a 
workplace learning system that an employer might regard as cost-effective, an 
employee might see as expensive, and vice versa. 

4 THE RESEARCHERS' PERSPECTIVE 

What do researchers need? 

If research is to make a contribution to workplace learning and assessment a number of 
issues need to be addressed. While those relate directly to researchers, they are vital 
considerations if a secure knowledge base concerning workplace learning is to be 
established and if initiatives are to result in improved outcomes. 

a. A body of data and good-quality research which they can readily access 

It does not matter how much research is conducted, the investment is of little value if it is 
not accessible without difficulty The more time researchers spend tracking down 
publications from obscure sources or obtaining copies of government sponsored studies 
which are out of print and have not been lodged in key libraries, the less time they can 
spend on research. 
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Once located, the research must be of sufficient quality to enable confidence to be placed 
in the findings. This means, among many things, that the work can withstand critical 
scrutiny by other researchers. It needs to be well documented, complete and described in 
sufficient detail to enable comparable studies to be conducted elsewhere. Summaries of 
finding s which may be sufficient for practitioners and implications which may meet the 
needs of policy-makers are inadequate in themselves for researchers. 

Research also needs to speak to different audiences. While research needs to be more 
theoretically sophisticated, it needs to avoid criticism from practitioners that it does not 
relate to them. This points to the need for different kinds of reporting from a single 
study. 

b. Research which is adequately contextualised 

The single most important feature of any research study is that it is clear what was being 
studied and in what circumstances the research occurred. The range of workplaces and 
organisational practices is far more diverse than those to be found in other educational 
settings and it is a necessary part of interpreting a study that all the salient features of the 
setting be taken into account. For example, many workplace learning practices are driven 
by industrial agreements and to describe the practices without considering the influence 
of agreements is to misinterpret what is happening. General surveys across contexts are 
vulnerable to criticism of this kind. 

Research ought to be fully contextualised - it has to be fully cognisant of the socio- 
economic and socio-cultural context as well as the institutional context. This does not 
mean that every research project should start with a comprehensive review of the global 
and domestic context. Rather there is an important place for "regional" analyses and 
research projects, but they should proceed on what can be termed ecological principles 
of full cognisance of the context of the local and specific. 

c. Research which is sensibly conceptualised 

Almost as important as the context, is the conceptual framework which the research 
adopts. All research has a conceptual framework, which takes account of other research 
conducted on similar topics or using similar research approaches, but sometimes the 
researcher does not know what it is or cannot explain it to others. Unless this is explicit, 
the biases and limitations of the research often cannot be considered and the status of the 
findings cannot be assessed. 

Research is severely limited if it consists of isolated studies. Unless it uses other work it 
is of very limited applicability. This means that reports must refer to and take account of 
other studies. Research needs to be both self critical and critical of the work already 
undertaken, so that each study can build on others in ways which provide perspectives on 
workplace learning which are larger than the sum of the parts. 
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There is also the problem that the overwhelming balance of Australian research into 
learning and assessment in the workplace has been descriptive and qualitative. Very little 
has sought to quantify or categorise the data. Very little has sought to test explicit 
hypotheses. 

d Sources of sponsorship for research which are not so tightly circumscribed that 
they cannot deliver a good quality product 

The outcomes of research are only as good as the questions which are commissioned For 
very good reasons of policy, practice and resources, studies may be constrained by time 
or scope. This does not pose a difficulty for researchers for any given project. However, 
if all research is influenced by short term requirements, then it will never be possible to 
create a literature which addresses broader questions of longer term significance. 

What has limited the value of research from the researchers' perspective? 

Does research on workplace learning and assessment meet the requirements of 
researchers as indicated above? The general answer is no. There are a number of issues 
which need to be addressed 

a. Research is not sufficiently accessible 

Encouragement is needed to publish and to lodge reports publicly, as is an effective 
clearing house for research material. The literature searches undertaken as part of the 
Impact Project indicate that only a small proportion of the Australian research which has 
been undertaken can be readily located and accessed. So little of it has been reviewed 
and collated to date that it is difficult to draw convincing conclusions from it. 

Research is not reported in systematic ways or in publications which are readily available 
beyond the. local context. The overwhelming volume of studies in Australia and overseas 
are reported only to the agency which funded them. A large proportion of these are 
government bodies which, while they do not typically bar publication, tend not to 
encourage or financially support publication in wider forums. When reports are publicly 
available, there is often a short print run, a limited circulation list and no consistency in 
lodging reports in libraries, clearing houses or indexes of publications (eg. the Australian 
Education Index). Much that is worthwhile is effectively lost. 

Informal publication in the form of reports does not encourage quality research. When 
the prime audience of a research report is non-researchers, there is a tendency to write 
for this audience and pay less attention to reporting on the kind of research issues which 
are necessary to ensure confidence in the outcomes. In quantitative research this includes 
issues such as adequate sampling and application of appropriate statistical tests; in 
qualitative research it includes matters such as ensuring that reported data adequately 
reflect the emphases of parties involved and suitably situating studies. 
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b. Research is inadequately contextualised. 

One of the characteristics of workplace learning is that it is highly complex and 
contextualised. Much of it cannot be understood outside its particular setting and the 
organisational practices within which it is embedded. Much more effort needs to be taken 
on revealing and reporting on the context of studies. This includes the motives of the 
various players who have initiated and participated in the study, the historic, economic 
and cultural context in which learning is taking place, the various incentives and 
disincentives which impact on the practice under study, the nature and backgrounds of 
the staff involved, etc. 

Little research takes sufficient account of work done by others. As suggested above, 
reports and other publications are short on reviewing the literature and locating the study 
reported among other studies. This leads to a scatter of unrelated and often unrelatable 
work which does not build to create a wider understanding of workplace learning. The 
involvement of university researchers in the area is too recent to have made much impact 
on any of the problems mentioned above, although they are slowly contributing to the 
wider dissemination of outcomes through publicly available journals. 

c. Research is inadequately conceptualised 

All research, no matter how ‘commonsensical’, is based upon a theoretical model or set 
of conceptions. More emphasis is needed on making these conceptions explicit and 
revealing the assumptions upon which a given study is based. There is a greater 
likelihood of research building from study to study if an explicit theoretical framework is 
adopted which can be debated and challenged. Errors and misconceptions cannot be 
corrected when they are buried in data. Very little current research in the area has grown 
from any models or conceptualisations of learning or assessment within workplaces. 
These theorisations are needed and research needs to support, question and test them. 

Research needs to be conceptualised across disciplines. Research on workplace learning 
exists at the intersection of many different academic disciplinary interests: education and 
training, organisational behaviour, economics, management, industrial relations, 
technological change, cultural studies, etc. This necessarily involves collaboration and 
greater communication paths between researchers who have different affiliations. Most 
important research questions have a multi-disciplinary character. 

d Research does not reflect the diversity of interests it serves 

We have assumed, for the sake of expediency, that there are three main groups of 
interests in research in workplace learning, but in practice there are many more and their 
concerns are many and varied. Within organisations, for example, there are varying 
interests depending on whether the perspectives of employers, workers, managers, 
unionists or shareholders are central. These interests are not reducible to a single 
perspective. Research on workplace learning must always acknowledge the existence of 
such interests and how they might impact on how research is conceived, what is being 
studied and how it is reported. 
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There is little independent research undertaken on workplace learning. The major volume 
of research is conducted at the behest of government agencies and is related to the 
priorities which they determine. There is apparently little research undertaken by 
organisations, except evaluative and costing studies that are directly related to the 
implementation of particular programs and not reported outside the organisation. There 
is hardly any research on workplace learning which has been funded from the 
competitively assessed and peer reviewed sources which normally support academic 
research. A small amount of research is beginning to be undertaken by research students, 
often in employment, which is independent in character. Research is driven at present by 
too limited a set of agendas. This means that the disinterest or independence needed to 
identify the totality of the context in which workplace learning occurs is missing. 

e. Research is insufficiently critical 

Too much emphasis is placed on simple description of practice. Analysis and critical 
reflection is neglected. Very little has sought to quantify or categorise the data. Very 
often accounts are taken at face value and the context and dynamics of organisations are 
neglected. A limited range of research approaches has been adopted. A strong theme 
concerns the need for research to question received wisdom and policy positions. 
Practitioners are uncomfortable that significant changes have been introduced to systems, 
processes and ideas with little or no apparent evidence that the changes will succeed or 
provide improved outcomes. 

Research on workplace learning is short-term, patchy and unsystematic. Studies are 
undertaken for reasons of policy and practice which normally relate to short-term 
concerns. Short term projects do not encourage reflection and consolidation of research 
across a wider front. Research to date has treated the various contexts and locations of 
vocational learning as if they were interchangeable, but there appears to be good reason 
for explicitly identifying the influences of the industry, the enterprise, the site, the HR 
context, decision-making systems, etc 

More critically evaluative work is needed. Research is required which explicitly seeks to 
evaluate the effectiveness of various approaches to learning and assessment in the 
workplace so as to provide practitioners with clearer guidance on choices between 
methodologies and assistance with their practice. 

There is relatively little strategic sense and consistency in the research which is 
commissioned. Priorities change from year to year, in response to changing government 
agendas and political pressures. There is little consistency over time of a kind that could 
lead to the production of a body of work which could realistically address any one of the 
issues currently on national agendas. While some degree of coordination could ensure 
that better value is obtained from studies, it is important that this be done in a way which 
respects the necessary variety of practice and the needs of researchers. Any coordination 
should seek the advice of researchers drawn from a variety of interests. 



5. FURTHER RESEARCH IN WORKPLACE LEARNING AND 
ASSESSMENT 

As will be clear, there is no shortage of work needing to be done in order to provide 
policymakers, practitioners and researchers with the information and perspectives they 
need in order to create a more effective VET system. But what questions would be 
particularly helpful to practitioners if researchers could illuminate them? We suggest that 
the strongest need is for research in three main areas: 

a. The nature of learning in the workplace 

Under this heading, we mean research into learning from a variety of disciplinary 
perspectives, including: 

• how learning occurs; 

• how it should be organised and controlled; 

• how it can be made to more effectively meet the needs of and benefit more people; 

• the classroom and the workplace as environments for lea rning ; 

• the extent to which common principles of teaching and learning are appropriate across 
the full spectrum of learning environments; and 

• how teaching and learning strategies interact with individual characteristics, such as 
gender and culture. 

b. An evaluation of recent reforms and developments 

Research which explicitly seeks to evaluate the effectiveness of various approaches to 
learning and assessment in the workplace, so as to provide practitioners with clearer 
guidance on choices between methodologies and assistance with their practice. 

Although evaluation is a particular type of research, rather than a topic area, it is listed 
here because of the paucity of research available which has either evaluated recent 
reforms using sound research methodology, or offered serious critiques, from a research 
perspective, of VET policy and the resultant practices which affect learning and 
assessment. Issues that are in need of urgent research attention are: 

• what features of VET reform have "worked", and why?; 

• how the various parties have benefited, and at what costs?; 

• the cost-effectiveness of various approaches to competency-based assessment; and 

• whether the current arrangements properly acknowledge informal lea rning or whether 
informal learning is distorted by the need to “fit the system”? 
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c. Research into system-wide issues 

Obviously, the effectiveness of workplace learning and assessment is greatly affected by 
the structures and policy within which it occurs. Research is needed into: 

• how to give people ‘the right ammunition’ to expand employer and employee 
involvement in VET?; 

• how to ensure that qualifications are recognised, regardless of where they come 
from?; and 

• what is the desirable mix of private and public provision and on and off the job 
provision? 

6. CONCLUSION 

Certain themes are noteworthy, particularly: 

a. The need for the context in which research takes place to be understood 

Research is needed which details the context within which the research takes place and 
makes this explicit. It has to be fully cognisant of the socio-economic and socio-cultural 
context, the institutional context, and the historical and strategic contexts. There is a 
critically important place for specific studies, but they should proceed with full 
cognisance of their local and specific context. 

Local or regional research projects ought, then, to be balanced and contextualised by 
broader studies of vocational and adult education and training informed by history, 
economics, sociology and government. These studies should form a much debated 
contextual framework for local and regional studies. 

b. A contribution to resolving the deep “either /or” divides 

A major recurring theme is the extent to which dichotomies have been imposed on the 
framework within which practitioners are required to operate. What contribution can 
research make to resolving the deep "either/or" divides which are increasingly being 
reflected within the disparity between policy/philosophy and practice? 

At a broader level, research is needed to reject the dualist ways of seeing or representing 
workplace learning and assessment-to express it in extreme terms, to see lea rning as 
either instrumentalist tools of exploitative capital or the vehicle for liberal progressive 
human fulfilment through lifelong learning. Workplace learning can be reduced to neither 
and it is constituted by variable elements of each, with the mix depending on the specific 
context and upon the actions of participants in those contexts. 




45 




c. A final comment 



One other aspect deserves comment. The landmark report No Small Change (McDonald 
et al. 1992) identified a number of shortcomings in VET research in Australia. In brief, 
they were that: 

• current research is fragmented; 

• there is little fundamental and general-issues-based research; 

• the research that has been carried out is not fully used; 

• the "big issues" need much more intensive research; and 

• there is no strong critique of policies and programs. 

What is striking is that these messages were essentially repeated by practitioners in the 
course of this project. This is despite the fact that there have, in fact, been massive 
changes in the amount of research activity and the amount of financial support for it 
since then. The most plausible explanation is that there is often a considerable time-lag 
between the funding of research to its application-through the stages of planning a 
project, carrying it out, analysing the results, publishing, developing materials, to the final 
application. 

The fact that these themes are still alive does, however, suggest a very strong argument 
that funding and policy bodies need to keep them uppermost in their minds as VET 
research becomes established in Australia 
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Session 2 The Users of Research: Use of Research by VET Providers for 
Improved Practice and Performance, and Policy and Planning at 
Provider Level. 

Brian Conroy 1 Speaking Notes 

1. About the Victorian Employers’ Chamber of Commerce and Industry 

• Largest multi-sector business organisation in Australia. 

• About 8,000 members. Very varied interests and perspectives. 

• Members in all sectors, but more than 60% in services sector. 

• More than 90% of members are in small business. 

• Active interest in VET. 

2. VECCI’s Interest in VET 

• Policy 

- MAATS 

- VET in schools 

- User Choice 

- Flexible delivery 

- Workplace assessment. 

• Participant 

- JITEC, a joint employer and union body concerned with VET. 

- VETAB 

- State Training Board 

- MCEETYA Task Force 

- Private Provider 

- Small Business Training Company. 

3. Impact of Research on Policy, Planning and Performance? 

Three categories of research: 

• Major studies commissioned by Government or Ministers. 

• Research for ITABs. Much of it has produced very significant positive outcomes in 
terms of changing the VET system. 

• Academic/theoretical research. 2 This is the group which worries me. 

1 Manager, Training and Education, Victorian Employers’ Chamber of Commerce and Industry, 

Melbourne. 

2 Most of the ANTA RAC research falls under this heading. I tend to feel that it has not led to much 

benefit to or changes in VET. I rang half a dozen industry contacts who work actively in the VET 
system. They stated that they had little knowledge of research in VET and gave little support to any 
substantial impact on decision making from such research. 
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4. Increasing the Impact of Research 3 

• Make it more relevant to key policy matters and tackle the harder issues. Some issues 
have been about for a number of years (eg. workplace assessment) and important 
aspects have not been tackled by researchers. 

• Do more than just report on observations; develop creative policy strategies. This is 
the hard part. 

• Develop alliances with stakeholders who have an interest in VET. 

• Become more aggressive advocates, either themselves or work with other advocacy 
organisations, including those from the business sector. 

• Use public relations more effectively. 



3 A number of these matters echo points which were made in the first session of the symposium 



Session 2 The Users of Research: Use of Research by VET Providers for 
Improved Practice and Performance, and Policy and Planning at 
Provider Level. 

Other Matters Raised in the Discussion Period 



Among the points raised in the discussion period which followed Session 2 of the 
symposium and which had not been included in the five formal contributions, four are 
noted. 

First, it was suggested that both short term consolidated overviews of particular research 
areas in VET and their implications for national and State/Territory level policy makers 
and for individual training providers and also the long term developments of new 
paradigms and greater insight into and understanding of important aspects of the VET 
systems in Australia justify greater emphasis. Both are necessary: the issue is one of the 
balance between them. A diversity of funding sources and some continuing attention to 
longer-term research projects (including longitudinal studies) were generally seen as 
desirable. 

Secondly, there was the suggestion that collaboration in VET research was highly 
desirable, for example, as between users and practitioners, between researchers or 
practitioners in different States or between industry and educational institutions, but that 
it is likely to take a considerable period of time and substantial persistence to change 
existing arrangements and informal habits of thought and action. 

Thirdly, further comments were made on the research process. It was emphasised that 
research skills and attitudes, as well as new and improved information, are important 
outcomes of the research system. It was suggested that “learning is more important than 
teaching”. It was stressed that a reasonable degree of policy stability or at least clarity of 
the broad directions of policy change was required if research was to make its maximum 
contribution to improved policy or practice. It was also argued that the impact of 
research generally flows, not from a single piece of research, but from the accumulation 
of studies which build on each other and illuminate an area of policy concern or of 
practice: quantitative assessment of impact will often be difficult, a fortiori for any one 
study. Unexpected or delayed use or impact is quite conceivable and may be frequent. 
In addition, research activities can increase the researcher’s visibility and potential 
influence with key stakeholders or powerful actors within research institutions. Research 
can have symbolic as well as instrumental outcomes on policy and practice. 

Fourthly, there appeared to be considerable support for the view that at least a modest 
research capacity (widely defined) in a VET provider assists in better adjustment to 
external policy change; to improved practice and performance in teaching, learning and 
community service; and to an enhanced capacity to interact with the wider research 
community, with favourable effects on institutional performance overall. 



Session 3 Research and Researchers’ Perspectives: From the Viewpoint of 
VET Research Institutions. 

John Owen 1 Speaking Notes 



KEY NOTIONS: 

• Distinction between use and factors affecting use. 

Use of research [professional social enquiry] within the working knowledge of 
practitioners. 

• Working Knowledge. 

The organised body of knowledge that administrators use spontaneously in their 
work. It includes the entire array of beliefs, assumptions, interests and experiences 
that influence the behaviour of individuals at work. It also includes science 
knowledge. The term working, as used here, has two meanings. First, it means that 
this is a special domain of knowledge that is relevant to one’s job. Second, it means 
that the knowledge itself is tentative, subject to change as the worker encounters new 
situations or new evidence. 

• Types of use: 

- instrumental use: when new knowledge is used for problem solving in an agency, 
and the need for knowledge has originated in that agency. 

- conceptual use: when new knowledge leads to users’ increased conceptual 
understanding and long term changes in thought patterns. 

- political use : when new knowledge is used as a weapon in an explicit political 
conflict. 

- interactive use. when new knowledge is used with other elements to construct a 
knowledge background for a key decision, such as to use a new technique or 
create a new policy. 

- legitimative use: when new knowledge is used to back up or justify a decision 
already made by an agency. 

• Professional social enquiry. 

Alternative approaches: 

- Scientific knowledge creation. Basic and applied research traditionally undertaken 
in universities and dedicated scientific agencies falls under this category. 
Development of theory is a goal of the work. 

Work of ‘typical university researchers in sociology and social science’. 



1 Centre for Program Education, The University of Melbourne. 
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- Investigator controlled applied research. The researcher believes that the work 
has practical implications. There is encouragement for users to collaborate. 

Some projects undertaken by the Australian Council for Educational Research and 
the Centre for Applied Educational Research at the University of Melbourne. 

- Investigator-user equality. Initiation of the problem can come from the researcher 
and user together or from the user. Either group can question the problem, but 
after the problem is refined, the researcher is responsible for the investigation. 

Program evaluation carried out by the Centre for Program Evaluation at the 
University of Melbourne. 

- User-oriented action. A user with a (local) problem asks for assistance from a 
researcher. A major source of advice is the expertise and past experience of the 
researcher. 

Action research fits within this model. This is a major form of investigation 
designed to empower providers and improve practice. 

- Consultancy advice. A user requests help from a non-specialist consultant in the 
area of concern. The non-specialist may be in the field of management or 
accounting or organisational design. The consultant gets ‘up to speed’ rapidly in 
the area of concern. 

‘Down town’ consultancy organisations which have emerged as a result of 
downsizing, the reduction of internal expertise, and an emphasis on ‘contracting 
out’. 
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Session 3 Research and Researchers’ Perspectives: From the Viewpoint of 
VET Research Institutions. 

Chris Robinson 1 Speaking Notes 



1. SOME OBSERVATIONS ABOUT THE IMPACT OF VET RESEARCH 

ON POLICY. 

Three issues: 

• What, if anything, does research tell us about the impact of VET research on policy? 

• How are VET policy decisions made and the role of research? 

• Future directions and the need to make VET research more relevant to policy. 

2. WHAT DOES VET RESEARCH TELL US ABOUT THE IMPACT OF 

VET RESEARCH ON POLICY? 

2.1 Comment 

• There is very little research which attempts to assess the impact of VET research on 
policy, almost none looking at the questions: 

- “How does research affect decision making at the training provider level?” 

- “How has research affected the general climate of public or employer support 
for training?” 

• Some exceptions are: 

- Butterworth, Perce (1995) “Some new challenges for research in vocational 
education and training”. 

- Butterworth, Perce (1994) “VET research in Australia: a long way to go”. 

- Butterworth, Perce (1993) “Research synthesis: research related to education 
institutes”. 

- Hall, William (1996) “Work and training”. 

- Hall, William (1993) “Does research influence policy?”. 

- McDonald, Rod and Hawke, Geof (1996) “How should we spend our research 
money?”. 

- McDonald, Rod, Hayton, Geoff, Gonczi, Andrew and Hager, Paul (1993) “No 
small change: proposals for a research and development strategy for vocational 
education and training in Australia”. 

- Ramsey, Gregor (1993) “Vocational education and training research: making an 
impact”. 

- Wiltshire, Kenneth (1993) “Role of research in policy making”. 



1 The Managing Director, National Centre for Vocational Education Research, Adelaide. 
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2.2 Observations 

• Quantifying the impact of research in a systematic way is difficult. Most work looks 
at “anecdotal evidence” or makes “general propositions”. 

• Research has had a limited impact on VET policy making. 

• Any impact has largely been ad hoc. 

• This research has also had a limited impact on VET research priorities and 
methodologies to date. 

3. HOW VET POLICY DECISIONS ARE MADE AND THE ROLE OF 
RESEARCH. 

3.1 Comment 

Four levels of policy decision making: 

• Pragmatic policy decisions: 

- no systemic consultation or research. 

- stakeholder views and selected research used in an ad hoc way to support a 
particular stance. 

- by far the most common. 

• Policy decisions based on consultation: 

- systematic consultation usually limited to invited participants/major 
stakeholders. 

- usually oral, not formal written submissions. 

- no research or limited ad hoc use of research. 

• Policy decisions based on Green / White Paper process: 

- systematic consultations. 

- opportunity for formal public submissions with no restrictions on who can put 
submissions. 

- close Ministerial involvement. 

- Ministerial preparation of Green Paper / discussion paper / consultation paper. 

- opportunity for further public comment on Green Paper. 

- subsequent government release of new policy in official White Paper. 

- a more systematic use of research to support approach. 

- but still tends to be a selective use of research. 

• Policy decisions based on independent public inquiry: 

- external and expert committee formed to undertake inquiry. 

- open and wide consultations. 

- public invited to make formal submissions in addition to major stakeholders. 

- systemic investigation of body of relevant research. 

- further research often commissioned. 

- relevant Ministers) at arms length from the inquiry process. 

- independent recommendations made to government in published report. 



- government considers public reaction to published report of enquiry before 
releasing official policy response. 

3.2 Observations 

• Relatively few key VET policy decisions are based on an independent inquiry process. 
A few exceptions are: 

- Kangan Report establishing modem TAFE system. 

- Kirby Report establishing traineeships. 

- Finn Report setting training targets. 

- Taylor Report reviewing ANTA Agreement. 

• Consequently, both extensive full public consultation and systematic use of research 
have played a relatively small role in VET policy decisions. 

• This is because of complex political context involving: 

- Commonwealth / State. 

- Employers / Unions. 

• This makes pragmatic and negotiated decisions the most usual approach and has 
sometimes led to a different kind of policy investigation approach, such as the 
Carmichael Report. 

• Policies appear to be more enduring when they are based on full consultation and 
systematic research. 

4. FUTURE DIRECTIONS 

• New national research and evaluation committee (NREC) has been established 
recently: 

- to develop an integrated national research and evaluation strategy. 

- replaces former array of advisory bodies. 

• National strategy will encompass: 

- ANTA’s national research and evaluation program; and 

- NCVER’s in-house VET research program. 

• New national research and evaluation strategy will be based on: 

- systematic research into themes of national VET strategy. 

- research and evaluation priorities developed by ANTA. 

- analysis of stocktakes of priority research areas to see what has already been 
done and to identify where gaps in knowledge exist. 

- consultation amongst stakeholders. 

• Key features of new strategy: 

- main aim is to make research and evaluation integral to VET policy decision 
making; 

- also to improve quality of decisions made by customers and providers of VET; 
and 

- dissemination and synthesis of research / evaluation findings just as important as 
doing research itself. 



Session 3 Research and Researchers’ Perspectives: From the Viewpoint of 
VET Research Institutions. 

Geof Hawke 1 Speaking Notes 

Focus on three particular areas where there are quite significant constraints on the 

capacity of research to impact on policy and practice. 

1. THE VET ENVIRONMENT 

• The nature of the VET sector is such that even research of short duration can be too 
slow for its relevance to policy. 

• “Secrecy” and speed of much policy development tends to lead to a lack of awareness 
by researchers of policy changes and current practice. Also, much material is 
‘commercial in confidence’. 

• Rapidity of change can lead to rapid outdatedness. Timeliness is a two way problem. 

• Poor availability of policy papers. Researchers may find that the relevant documents 
or other material on which policy has been based, or is to be based, are not available. 

2. CONTRACT-DRIVEN RESEARCH 

• Is increasing, but contracts often driven by short-term interests. The commissioning 
bodies may be looking for simple answers to simple questions. Buyers tend to be 
becoming narrower and more specific in their requirements. Collateral information 
and analysis may be being constrained. 

• Inadequate specification of many tenders, especially as to the expected outcomes. 
Some specifications seem to focus more on methodology than on expected outcomes. 
There is sometimes a failure to specify exactly what the buyer wants. This presents 
problems for researchers, but it originates in the decision-making systems. 

• Tendency to stifle critical analysis. Contract driven research may discourage 
researchers from asking the really difficult questions. Sometimes the users “want nice 
supportive answers to questions on which they already know their own decision / 
position”. 

3. LACK OF RECOGNITION OF APPLIED RESEARCH 

The increasing interest in outsourcing. VET research may not be equally highly valued in 

the university context, eg. for 

(i) the DEETYA Research Quantum; or 

(ii) University promotions criteria for staff. 



1 Senior Research Fellow, Research Centre for Vocational Education and Training, University of 
Technology, Sydney. 
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Session 3 Research and Researchers’ Perspectives: From the Viewpoint of 
VET Research Institutions. 

Gerald Burke 1 Spoken Comments 



• The VET research undertaken by consulting firms is increasing. Such researchers 
may be prepared to tailor their reports to the perceived needs of their customers. Are 
they always, indeed are other researchers always, willing to tell the full story, warts 
and all? However, in other cases they may be as independent as the university 
researcher, who is increasingly dependent on outside funding. After all, in the long 
term, researchers, irrespective of the setting in which they undertake their research, 
are dependent on their reputation for undertaking valuable work. 

• The Monash University - ACER Centre for the Economics of Education and Training 
(CEET) aims to be relevant to the concerns of policy makers and practitioners - and 
not only because it is in the funding agreement with ANTA. It is quite high in our 
priorities. Interaction with a range of stakeholders in VET assists us in understanding 
current policies and practice; it tends to foster an increase in mutual understanding. 
However, there is an issue of the time commitment which is required compared to 
other priorities, such as getting on with the research. 

• CEET does emphasise dissemination, secondments and research training. Our work 
in this area has taken a quantum leap since we began to receive ANTA RAC funding. 
We are finding that we need to present in a range of different ways and in a range of 
different forums. One may need to continue to interact with users and potential users 
in relation to the findings of a research project over an extended period. 

• Some CEET projects are directly relevant to policy concerns or to current practice, 
but others are longer term in orientation and may seek to increase the knowledge 
base, to undertake general reviews of particular areas of concern to VET or to 
provide information and analysis which can be drawn on by others, whether 
practitioners, policy makers or other researchers (perhaps over an extended time 
period). The immediate implications of such research studies for policy or practice 
are not always clear; and the eventual use or impact may be diverse. 

• There can be value in studies which critically examine current approaches, existing 
objectives or the degree to which they are achieved. If critical findings impact on 
continued funding the research results and their implications may not be fully explored 
and widely disseminated. Perhaps researchers need to cultivate a diversity of funding 
sources, so that they are not too dependent on a single source and can continue to 
proffer independent advice based on the evidence they observe. 

• In the long run the impact of research in relation to both VET policy and VET 
practice will be influenced by the quality of the research and also by the quality of its 



1 Executive Director, Monash University - Australian Council for Educational Research Centre for the 
Economics of Education and Tr aining , Monash University, Melbourne. 
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dissemination. “Sustained interactivity”, as Martin Huberman has noted, can be an 
effective means of fostering instrumental change. 
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Session 3 Research and Researchers’ Perspectives: From the Viewpoint of 
VET Research Institutions. 

John Ainley 1 Spoken Comments 



Discussing the impact of research on vocational education and training policy and 
practice from the viewpoint of a research institution I will consider four issues that arise 
from the experience of conducting research in school eduction. These issues concern: 

• the importance of cumulation in building a body of research-based knowledge; 

• diversity in the origins of research problems and destinations of research results; 

• the multiple pathways through which research comes to impact on policy and practice; 
and 

• the importance of timing and the planning of the dissemination process. 

First, the research enterprise is a cumulative one. A piece of work rarely stands on its 
own, although some commissioned work may need to address a specific matter “and it 
remains just that”. But even of commissioned research, much ultimately goes into the 
body of accumulating knowledge. The implication is that we do not just look at study A 
and seek to estimate what the outcomes of study A were in terms of policy or practice. 
In some cases it may be more helpful to ask where did this idea or practice originate? 
And what part in that process was played by research activity and research findings? 
“Trace back studies” take the outcomes or the practice and ask where that innovation 
came from. The results of those studies tend to be more encouraging to us as 
researchers: we generally find that there were a multiple of research studies which had an 
impact on practice. It depends on conceiving of the research enterprise as contributing 
to an accumulating body of knowledge. Some trace back studies in science and 
engineering suggest that the benefit from research activity may be greater from 
fundamental research than from more applied research. The findings are not always in 
the direction of favouring immediate relevance and immediate practical application. 

Secondly, there is the notion of multifaceted sources of, and destinations for, research. 
Some practical problems may seek, even obtain, solutions from the world of scholarship 
and can be used in the world of practice. There are also a wide range of possible 
interactions. In considering the utilisation of research we should not only be looking at 
problems which were defined by policy or practice, but also look at research which 
originated in the world of scholarship, some of which have had tremendous implications 
for the world of practice as well. Conceptualising sources and destinations in this way 
makes us think rather more broadly about where the research knowledge comes from, as 
well as where it is going. 

Thirdly, there is the issue of multiple pathways and impacts. We need to think about the 
utilisation of research-based information in terms of impacting on a number of people, 
including policy makers, teachers and practitioners, designers of curriculum materials and 



1 Associate Director, Australian Council for Educational Research, Melbourne. 



courses, and many others. The pathways can go via many routes rather than via just one 
(say, policy maker to researcher); and the influence can go through indirect as well as 
direct pathways, eg. through the climate of ideas or the way people think about an issue. 
And how does a particular individual or group recognise that the source of this or that 
idea which began to circulate originated in research? Huberman (1990) argues that the 
stronger the links between policy people and researchers, and Cousins and Leithwood 
(1986) argue that the stronger the links between teachers and researchers, the stronger 
those pathways are likely to be, with a greater likelihood of the uptake of new ideas. 
The linkages may, of course, at another level be just a means of ensuring that the right 
questions are addressed rather than something valuable in themselves. 

Fourthly, we can reflect on a number of ACER projects and the characteristics of those 
projects which led to some having more impact than others. Timing was important, but 
the right timing in retrospect was more often fortuitous than planned. Timing can be 
important at the beginning of a project as well as at the end. The issue was important 
and significant to someone. The quality of the study was sound: generally research 
findings did not get taken up if the quality of the study was poor. The message in these 
reports tended to be clearly identified and expressed. The potential users knew about the 
study; it was part of the thinking of people to whom the report was going to be directed. 
Finally, ACER had formulated a dissemination strategy: “We did not just dump it on the 
desk and go.” The biggest impact came when ACER had thought carefully about who 
needed to be informed about the research report, its findings and its possible uses for 
policy or practice. 

References: 

Cousins, J. B. and Leithwood, K. A. (1986) “Current empirical research on evaluation 
utilisation”. Review of Educational Research, 56(3), pp 331-364. 

Huberman, M. (1990) “Linkage between researchers and practitioners: a qualitative 
study”, American Educational Research Journal, 27(2), pp 363-391. 
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Session 3 Research and Researchers’ Perspectives: From the Viewpoint of 
VET Research Institutions. 

Other Matters Raised in the Discussion Period 



Among the matters raised in the discussion period, but which were additional to those 
made in the five contributed papers, three are noted. First, it was argued that research in 
VET should be “bottom - up” as well as “top - down”. Some participants in the 
symposium argued that too much research on the VET sector ‘is being imposed from 
outside’ including by governments, bureaucrats and universities, although other 
participants argued that the situation was changing. They suggested that research within 
the VET sector, by VET participants, should be increased; and that such research is 
more likely to be implemented. 

Secondly, it was noted that the session, while raising a range of different forms of 
knowledge, of use, of linkages and of settings (both research, policy and practice 
settings), had not provided much definitive guidance on the balance between them. 
Since resources are limited and not all desirable objectives can be met, what priority 
should be given to particular research activities? There was some suggestion that an 
undue focus on short-term, instrumental, commissioned research, with strong influence 
from users, could in the longer term undermine the developing knowledge base and be 
counterproductive for better policy or practice in VET. 

Thirdly, it was noted that in the United States the private foundations, although they 
represent only a small proportion of total research funding, nevertheless play an 
important role in funding good quality but unpopular or unfashionable research: they can 
be applied or more fundamental studies which tend to be “very much out of vogue” with 
powerful groups at the time. But competent and experienced researchers want to do it 
and peer review supports it. It is important to keep the portholes open for “the 
unexpected”, “the critical” and “the dubious ducks”: “the naysayers and the doubters 
should be kept in research”. 
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Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 
Other Sources of Research. 

Robert Bluer 1 Speaking Notes 



This session considers the impact of VET research from the viewpoint of other sources 
of research. These perspectives may be important because they come from people who 
are often considering how VET research may be of use to them in special contexts. 

For example, the formal inquiry process will typically commission research as well as 
drawing upon existing research. Those involved in guiding the inquiry process may be in 
a position to judge the influence or impact of VET research. They may be able to say 
how much existing research is useful and valuable in relation to answering terms of 
reference or whether the process is so circumscribed as to require new work. 

Similarly, expert advisers to government, or to other organisations and corporations, 
may or may not be aware of existing research and the way it can be used and shaped to 
assist the process. Working as an expert adviser to government will often require close 
contact with the bureaucracy. This could provide another perspective on how 
government departments use research. 

The impact on VET of research in various disciplines, especially from the perspective of 
the academic, could provide insights into the value of current research and research in 
progress. Even in terms of education research, VET research is a comparative 
newcomer. How it fits with the current education researchers’ paradigms, if at all, could 
be instructive. 

Finally, private consultancy in education and training is now a large and growing 
business; one in which the universities themselves are heavily involved. To what extent 
is VET research drawn upon and valued in this particular context?; one which often 
requires quick, if not dirty, work. 



1 Private consultant in education and training. Formerly, Counsellor to the National Board of 
Employment, Education and Training. 
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Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 
Other Sources of Research. 

Don Anderson 1 Spoken Comments 



By its nature, research cannot bring matters to closure: only decisions can bring closure. 
In the case of the report on ACT secondary colleges the report’s recommendations were 
accepted by government. The government’s wishes were legitimated by the research 
undertaken for the inquiry. 

There can be a wide range of reasons to establish an expert inquiry, including: to buy 
time on a contentious issue; to placate significant pressure groups (even to neutralise 
them); to legitimise decisions the Government wishes to take in any case; to distance 
decision making authorities from potentially difficult decisions; or from a genuine view 
that the quality of dicision making would be improved. 

The formal inquiry is a major way of proceeding to involve research (and much else) in 
decision making. It can draw on research already undertaken; it may be able to 
commission specific research in relevant areas; it can seek research information from 
others through submissions or public hearings; it can employ consultants and its own 
research staff. Anderson noted that research can be extensively drawn on by informal as 
well as formal methods, for example, when the chairperson or committee members are 
researchers or conversant with research and thinking in the relevant areas. 



1 Don Anderson kindly agreed, at short notice, to provide some comments in relation to the formal 
inquiry process, given that Barry McGaw was detained in Sydney finali sing his report to the NSW 
Government. A relevant paper prepared by Professor McGaw is reproduced after this contribution: it 
was available for, but not distributed at the symposium. Professor Anderson is at the Centre for 
Continuing Education in the Australian National University, Canberra. 
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Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 
Other Sources of Research. 

Barry McGaw 1 Prepared Paper 



NATURE AND FUNCTION OF EDUCATIONAL RESEARCH 2 

The term ‘research’ is so widely used these days that it has almost lost its currency. It is 
used by primary school children to describe information gathering in a library, by adults 
in virtually every walk of life to describe any activity in which they are finding out 
something they did not know already, regardless of how many people might already 
know it, and by professional ‘researchers’ as a specialist term to cover a great variety of 
activities. 

For any serious discussion, however, we must claim specialist use of the term ‘research’, 
but then make clear what will fit under the term and what subclassifications we might 
wish to use. The title of this session invites such a discussion. 

CHARACTERISING EDUCATIONAL RESEARCH 

Broad definition of research and development 

The Organisation for Economic Co-operation and Development (OECD) conducts 
regular surveys of research activities, but focuses more broadly on research and 
experimental development which are defined in the Frascati Manual as: 

creative work undertaken on a systematic basis in order to increase the stock of 
knowledge, including knowledge of man, culture and society, and the use of this 
stock of knowledge to devise new applications (OECD, 1992, p.29). 

The key distinguishing characteristics of research and development are originality and 
investigation as a primary objective. Under this definition, the Frascati Manual excludes: 

• education and training, except for postgraduate students' research and its supervision; 

• scientific and technical information services; 

• general purpose data collections; 

• policy related studies such as the analysis and assessment of existing programs and the 
work of legislative commissions of inquiry; and 

• testing and standardisation. 



1 Professor McGaw is the Director of the Australian Council for Educational Research, Melbourne. 

2 Invited address presented to Jubilee Conference of the National Foundation for Educational Research 

in England and Wales, Windsor, England, 2-4 December 1996. 
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Where would national or international programs to monitor student achievement fit, for 
example? Are they to be seen as 'general purpose data collections' in whole or in part? 
Should national monitoring programs be considered 'research and development' in the 
initial years as novel systems are developed and implemented and then be removed from 
the category once the program becomes established? Should the 'horse-race' part of 
international surveys be excluded and only the exploration of relationships between 
achievement levels and other variables be included? 

Some investigative activities common in education would be excluded. Applying well- 
established techniques to problems, such as in the diagnostic testing of children with 
learning disabilities, would be excluded, and indeed this example is explicitly identified in 
the Frascati Manual as a case for exclusion (p.34). If the data from such tests were 
collected as part of a study of the links between other variables and learning disability, 
then the testing component would constitute research and development. 

The OECD definition and its associated exclusions may be of little immediate relevance 
in a conference on educational research but non-trivial in other contexts. Both national 
surveys of research and development activities and the OECD surveys which draw upon 
them document the extent of national investment in educational research and 
development, with the OECD definition and its exclusions determining, or influencing, 
what is counted. In addition, the OECD education indicators reports in the Education at 
a Glance series will also now include indicators of national investment in educational 
research and development established on a similar basis. 

Subclassifications of research and development 

The Frascati Manual defines three main subcategories of research and development 
activities: 

• Basic research: experimental or theoretical work undertaken primarily to acquire new 
knowledge, without any particular application or use in view; 

• Applied research: original investigation undertaken to acquire new knowledge but 
directed primarily towards a specific practical aim or objective; and 

• Experimental development: systematic work, drawing on existing knowledge, 
directed to produce new products, processes, or services, or to improve existing ones 
substantially. 

An education-specific example is provided by the Frascati Manual (Annex V), 
distinguishing these three types of research and development in the field of reading: 

• Basic research: study of the reading process, for example an investigation of how 
human visual systems work to acquire information from symbols such as words, 
pictures and diagrams; 

• Applied research: study of the reading process for the purpose of developing a new 
teaching method; and 

• Experimental development: development and testing of a special reading program. 



For the Australian national research and development surveys, the Australian Bureau of 
Statistics subdivides basic research into pure basic and strategic basic research 
according to the following definitions: 

• Pure basic research: research directed into specific broad areas in the expectation of 
useful discoveries; and 

• Strategic basic research: research providing the broad base of knowledge necessary 
for the solution of recognised practical problems. 

Education as a field or discipline 

The OECD classifications are generic in the sense of being intended to apply to all fields 
of research and development. When it comes to education, there is not only the question 
of how these definitions might be applied, but also the question of what research and 
development should count within the category of education. 

My preference is to see education as a field and not a discipline. This preference arises 
from the diversity of what, on any reasonable grounds, could be claimed to be 
educational research and development. Diversity is evident in the substantive questions 
addressed, ranging from learning and teaching to the politics of education; in the scope 
of the questions, ranging from learners and teachers to systems; and in the methodologies 
used, quantitative and qualitative. It is also clear that educational research and 
development is informed by a variety of disciplinary perspectives. What makes a 
particular research and development activity educational is its focus on the field of 
education. 

Taking education to be a field of inquiry and not a discipline is not without problems, 
however, since the boundary of the field will inevitably be somewhat vague, wherever it 
is drawn. This can be illustrated by responses to the Australian Bureau of Statistics' 
surveys of research and development activities. 

In those surveys, the Bureau uses not only the subclassifications by types of research 
(pure basic, etc) but also subcategories of Field of Science and Socioeconomic 
Objective, the latter referring to the area of expected national benefit from the research. 
In the survey for 1988-89, expenditure on educational research and development (in 
March 1992 prices) was reported to be $70.3 million for education as a socioeconomic 
objective, but $63.6 million for education as a field of science. The latter figure was 
lower because it excluded expenditure on educational research and development incurred 
outside of the field of education by researchers declaring their allegiance to some other 
field in the social sciences or humanities, usually a discipline. 

This kind of distinction is not possible in the OECD reports, since OECD includes 
education in its Fields of Science cmd Technology but not in its Socioeconomic 
Objectives. That is, the OECD classification includes education only in the list of 
'disciplines', while the Australian inclusion of it in both subclassifications allows the 
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possibility of work having disciplinary orientation and a commitment to the field of 
education. 

Discipline research in educational settings 

The term educational research is best preserved for work in which the central organising 
feature is a dominant commitment to the field of education. If the research focus is the 
concerns of a discipline, the work ought to be seen as related to that discipline and so 
named. The research may be relevant to education but still not be educational research. 

There are numerous examples of research relevant to education, on which educational 
researchers and even policy makers and professional practitioners may draw, without 
these examples needing to be named as educational research. Within the discipline of 
psychology, research on learning, on the nature and development of expertise, on human 
development, and on attitude formation can all fall within the category of educationally 
relevant research without being called educational research. Within the discipline of 
sociology, research on social class and socioeconomic status can be relevant to education 
and can crucially inform educational research on the social reproductive role of schools. 
Within the discipline of politics, research on policy making in federal systems, even work 
on educational policy making, can be relevant to education without being educational 
research under a definition which demands that the prime focus be education and not the 
discipline. 

There are many professional researchers in educational research institutions, particularly 
university faculties of education, who are inclined to honour a disciplinary perspective 
from which they work as their raison d 'etre as researchers rather than the field of 
education, even though they may claim their work to be relevant to education. For them, 
the appropriate course would be to transfer to the relevant disciplinary department. 

Links with policy and practice 

Demanding of educational research that it have a central commitment to the field of 
education does not resolve, in any immediate or straightforward fashion, the manner in 
which the research endeavour contributes to the field. To do that requires consideration 
of the manner in which research can link with policy development and professional 
practice. It also opens a significant epistemological debate. 

Academic and professional concerns intermingle in educational research. Academic 
concerns typically range across the purposes, procedures and reporting of educational 
research. Professional concerns tend to be practical. They draw upon educational 
research as a body of ideas from which to generate new solutions, not new knowledge. 
In some cases, policy makers and practitioners seek enlightenment to inform their action, 
in other cases they seek recipe knowledge to prescribe their action. 

Educational research is thus expected to generate different kinds of knowledge, 
reflecting the different questions with which different groups approach it. While they may 
all have a connection with the fields of policy and professional practice, there is not the 
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same immediate concern in all cases with implementation, or even identification, of 
desired changes. The reason is that the sources of their questions vary. Sources of 
research questions can include: 

• intellectual curiosity; 

• hypotheses arising from theory; 

• personal concern about particular problems; and 

• requests from policy agencies (Anderson, 1986). 

Another way of thinking about the differences between researchers and those 
professionally engaged in the practice of education, either as policy makers or as 
teachers, is in terms of their professional perspectives. Key differences are summarised in 
Table 1. 

Table 1: Differences in perspective of researchers and professional practitioners 



Researchers 


Policy makers and practitioners 


willing to work on parts of problem 


complex, applied problems - holistic, 
context-based 


interested in raising new questions 


interested in facilitating policy and practice 
choices 


preference for critical analysis and critique 


sometimes a preference for legitimating 
choices already made 


professional rewards (promotions criteria) 
emphasise basic research 


professional rewards depend on 
development and implementation of 
changes in policy and practice 



The epistemological debate in educational research is more fundamental than the 
differences in perspective of the community of researchers and the communities of policy 
makers and practitioners. It is to do with the manner in which knowledge is gained and 
that, in turn, depends on how educational research is conceived. Four long-term 
epistemological tensions are evident in educational research, with it conceived as: 

• either a natural or an interpretative science; 

• either a laboratory or a practical science; 

• either a universal or a local science; 

• either serving deliberative or practical ends (McGaw et at., in press, p.4). 

Much of the epistemological debate in the past has been advanced as though there were a 
single answer, with the result being successive epistemological and methodological 
hegemonies. When the positivist tradition was dominant, natural science conventions 
were mimicked and a pre-eminent role assumed by quantitative psychological research, 
cast primarily in the experimental mode with treatment and control conditions. More 
recently, as the interpretative tradition has become more dominant, a stronger place has 
been given to research conventions drawn from sociology and anthropology. 
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Natural science investigation 



The natural science tradition has not disappeared entirely. It continues on the assumption 
of a natural, lawful reality to be discovered, pursuing it through controlled 
experimentation and the quasi-experimentation afforded by semi-controlled studies 
capitalising on natural covariation and using statistical adjustments to control for pre- 
existing differences by casting questions in an 'other things equal, what it?' form. 

In the natural science tradition, the experimenter maintains an objective distance from 
subjects. Interpretations are expected to be verifiable by an independent data analyst and 
the data gathering itself replicable within sampling error in independent circumstances. 

Whether the conclusions are anticipated to be universal or local depends on the extent to 
which the effects being investigated are understood, or expected, to be free of cultural 
influences. In his famous address to the American Psychological Association on the 
receipt of a Distinguished Scientific Contribution Award, Cronbach (1975) introduced 
the possibility of local laws as the product of psychological research in the natural 
science tradition and proposed systematic investigation of interactions of other variables 
with local conditions. The most notable work that flowed from his proposal was the 
investigations of aptitude-treatment interactions that he subsequently reviewed 
(Cronbach and Snow, 1977). A more elaborate method for investigating interactions of 
context with research findings was provided by meta-analysis (Glass, 1976). 

Connections with educational practice from this research tradition first proceeded in the 
belief that experimental, or quasi-experimental, conditions shown to be efficacious could 
be engineered into programs or materials to be used by professional practitioners. 
Greater understanding of the complexities of the domain of professional practice led to 
more modest expectations of influence, but not an abandonment of the principle of the 
efficacious experimental treatments serving as a guide to professional practice. There 
remains an expectation that good research will help to shape planned interventions. 

In some cases, implementation itself becomes the subject of experimental investigation. 
Good research on learning usually leads on to instructional research which is then seen as 
providing essential validation of the conclusions of the learning research. On a larger 
scale and usually in a quasi-experimental mode, evaluation studies investigate the impact 
of programs in complex settings. 

Interpretative studies 

Research in the interpretative tradition reflects new ways of thinking about knowledge 
and competence in human practice. It sees knowledge as actively constructed by 
individuals, but not in isolation from the communities in which they develop. That is seen 
to be true of learners who might be the focus of professional practice and research, but is 
seen also to be true of researchers and professional practitioners. 
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Individuals are seen to participate in communities of discourse which shape the 
behaviour of all participants. The research community has a scholarly discourse within 
which theories are developed and accepted modes- of challenging theories established. 
The communities of professional practitioners and policy makers also each develop a 
common language which shapes individuals’ interpretations of their own practice and of 
the possibilities of their work. 

Research in the interpretative mode usually seeks to understand not just what people do, 
but how they derive meaning from what they are doing. Much interpretative research 
focuses on the nature of discourse in various communities of practice. In education, 
various studies are now charting the language of classrooms, with particular attention to 
the ways in which students are initiated into the questions, points of view, expectations 
of evidence, and forms of verification of different disciplines. The policy development 
process is being subjected to similar analyses. (See McGaw et al., (in press) for a 
discussion of the interpretative tradition.) 

Interventions and evaluations 

Another body of educational research takes social change as its object of inquiry, and 
seeks both to evaluate the .overall effectiveness of interventions and to determine which 
aspects of an intervention, singly or in interaction, are responsible for positive or 
negative effects. In educational research, the interventions are likely to be programs of 
teaching or curriculum change, but they may also be broader policies about, for instance, 
patterns of funding or selection of students. 

Intervention and evaluation research calls for careful observation and measurement 
within either a natural science or interpretative framework. Because the objects of study 
are complex social interventions, attention must be paid to specifics of context, including 
historical and cultural factors that may influence the implementation of planned 
interventions. 

The focus may be deliberately designed interventions, sometimes designed by the 
researchers themselves. In such cases, control or comparison groups are typically used to 
estimate the effects of the intervention. Various statistical adjustments may also be used 
to control for possible confounding or interacting variables. 

In other cases, natural variations in educational programs can provide comparisons of 
different interventions. Comparisons are possible between countries, states, schools or 
even individual teachers. Inferences from these non-experimental studies of natural 
variation depend on the use of increasingly sophisticated statistical procedures. 

REVIEWS OF EDUCATIONAL RESEARCH IN AUSTRALIA 

Three reviews of educational research have been conducted in Australia in recent years 
under the auspices of the Australian Research Council. One provided a review of the 
then state of educational research and proposed a variety of policy changes in relation to 
the research enterprise (McGaw et al., 1992) and a second provided a similar review 
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focused more narrowly on research in vocational education and training (McDonald et 
al., 1993). The third reviewed the outcomes of educational research projects funded 
under the Australian Research Council's Large Grants Program in the period 1989 to 
1993 (McGaw et al., in press). 

It is instructive to reflect on the findings of these reviews in terms of the analysis of the 
nature of educational research and development presented in the preceding sections of 
this paper. Given the strong links many Australian educational researchers have with 
counterparts in other countries, it is likely that the Australian experience will be similar to 
that in other places. 

Strengths 

By some measures, educational research in Australia was shown in the strategic review 
to be in good shape. From the major national funding agency for basic research, the 
Australian Research Council, education attracted 15 per cent of large grant funds 
allocated to the social sciences in 1992. This proportion was exceeded only by 
psychology (40 per cent) and economics (23 per cent), and was well in advance of 
sociology (7 per cent) and geography (6 per cent). In funding for new projects, 
education was second after psychology (McGaw, 1992). 

Funding for educational research, however, was relatively low considering the size of the 
education sector within higher education and appeared to have been associated with a 
relatively low rate of applications from education academics - about 1 per 50 full-time 
equivalent education academics compared with about 1 per 25 full-time equivalent non- 
education academics in the social sciences. The relatively low application rate reflected 
the history of much of the education sector in higher education - originally in teachers 
colleges and then in colleges of advanced education without a research brief or 
infrastructure funding for research and only in the early 1990s transferred fully into the 
university sector. This has had some impact on the profession's view of research as well, 
with the great majority of teachers trained in institutions and by staff without any 
substantial engagement with research. That is very different from the education 
environment in fields such as medicine and psychology. 

A great deal of the educational research is of high quality. This judgment was confirmed 
by a systematic analysis of the outcomes of the education research projects that gained 
the highest levels of Australian Research Council funding over the five-year period 1989- 
93. Work from these projects was widely published in international journals and the 
researchers had formed strong links with leading overseas researchers in the specialties. 

Weaknesses 

Despite these strengths, there was other evidence of serious problems. The whole 
educational research enterprise seemed at the time of the strategic review in 1992 to be a 
fragile resource requiring some reorientation and increased support. Areas of concern 
evident in submissions to the review included: 
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• education administrators and practitioners perceiving much educational research to be 
irrelevant to their concerns; 

• educational researchers perceiving a lack of support for and interest in their work 
from government agencies and the higher educational sector; 

• there being little effective dissemination of research; 

• research activities being poorly coordinated and thinly spread; 

• funding being low relative to the size of the education sector (0.35 per cent of 
education expenditure being allocated to research and development compared with 
1.40 per cent - and soon after 2.0 per cent - of health expenditure being allocated to 
research and development); and 

• there being little planning for training researchers. 

Researchers seemed generally isolated from one another, working as individuals on their 
own projects, and certainly isolated from the communities of policy makers and 
practitioners. That was not true for all, however, as the subsequent review of the 
outcomes of the large grants revealed. Much of the work on those large grant projects 
involved coherent teams of collaborators, sometimes in different locations, but working 
together in a sustained way. A good number of them had also forged effective links with 
policy makers and practitioners. 

EXAMPLES OF EDUCATIONAL RESEARCH AND DEVELOPMENT 

So far I have offered a general description of the nature of educational research and 
development and a brief reflection on the conclusions of several substantial reviews of 
educational research in Australia. I now turn to three examples of current Australian 
educational research which have a strong standing in the research community and well- 
developed connections with the communities of policy makers and practitioners. 

There are other examples that I could have chosen, of course, but these will illustrate the 
point that there is no single paradigm for effective research nor any single epistemology 
that can describe the links between research and professional practice. 

Cognition to learning to instruction 

The first example is of research on learning, derived from a strong theoretical model of 
cognitive processes and leading on to instructional research and successful 
implementation in workplace training. 

Sweller has developed a theoretical model of problem solving and learning which 
accounts, in terms of cognitive load, for the variable levels of success of different 
instructional strategies. The model grew out of extensive studies of learning (e.g. 
Sweller, 1983, Sweller and Levine, 1982). 

Subsequent work established that some standard techniques for teaching problem solving 
in mathematics, such as working numerous examples, can be very ineffective because the 
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cognitive demand of the problem solving tasks themselves is often so great that 
insufficient cognitive resources can be directed to learning the structure of the problems 
and thus acquiring the intended general problem solving skills. This led on to the 
identification of more effective teaching strategies that reduce cognitive load and direct 
cognitive effort to learning rather than to extraneous activities, and then on to the 
definition of the characteristics that those strategies must have. For example, studying 
worked examples in algebra can produce faster and more effective learning of problem 
types and problem solving strategies than solving sets of problems (Sweller and Cooper, 
1985). This is not true for all worked examples and the research provides both a 
theoretical explanation of why it is not and a delineation of the characteristics of worked 
examples that will be effective (Ward and Sweller, 1990). 

Sweller extended the application of his model of learning by working in industry, 
developing instructional programs for staff to improve the rate at which operational skills 
are acquired. New techniques for formatting instruction, which better manage the 
cognitive load of the learners, have proved highly effective (Sweller et at., 1990; 
Chandler and Sweller, 1991). 

It is interesting to note that, while S Weller's application of his work to mathematics 
education was not warmly embraced by some mathematics educators, as illustrated by 
the reception for a presentation he made to the Mathematics Education Research Group 
of Australia, his work on industrial training has been speedily taken up. The company in 
which he and Chandler worked contributed substantially to the funding of the research 
and development and then collaborated in a successful submission for further research 
funding from the Australian National Training Authority Research Advisory Council. 
That further work has demonstrated that the use of redundant information in multi-media 
presentations (e.g. presenting the same information as text to be read and in audio 
presentation) inhibits learning by increasing the cognitive demand of the learning task 
without benefit. 

Sweller 1 s work represents a sustained effort within the tradition of natural science 
investigations. It has clear and strong connections with aspects of professional practice 
and has provided systematic evidence of the efficacy of instructional strategies based 
upon it. 

Longitudinal study of individual progress 

The second example is of a longitudinal study, following successive national samples of 
individuals from upper primary or lower secondary schooling to adult life, with annual 
documentation of education and labour market participation. It is work in the tradition of 
quantitative sociology, fitting linear models to data to explore the links between a variety 
of educational and social background factors and subsequent educational performance 
and workforce participation. 

Using samples of individuals bom in 1961, 1965 and 1970, Williams and his colleagues 
documented changes in patterns of participation in the final years of secondary schooling 
and in higher education of groups making the transition to higher education at the 





72 



beginning, in the middle and at the end of the 1980s (Williams, 1987; Williams et al., 
1993). 

This work showed the broadening social base of the student cohort continuing in 
education as participation rates rose, but documented the continuing strong influence of 
socioeconomic factors on completion of secondary education and participation in higher 
education. In these respects, it provided direct evidence on the effectiveness of policies 
of the Commonwealth government intended to increase equity in participation in 
postcompulsory education and the Commonwealth drew heavily on the work in its own 
private and public evaluations of its policies (Commonwealth Department of Education, 
1987). 

This research also demonstrated that private schooling has an influence on school 
completion and access to higher education which is not explicable in terms of the 
relatively select nature of the students enrolled in private schools, that is, not explicable 
in terms of social characteristics or prior educational achievements of the individual 
students but rather attributable to the schools themselves. Those conclusions generated 
an ongoing debate about the influence of school type on subsequent success. 

More recent work with this longitudinal database, using additional national samples of 
individuals bom in the years up to 1980, has provided new evidence about increased 
equity in the Australian education systems. This work shows that family socioeconomic 
status has had a declining influence over a 20-year period on students' performance levels 
in reading comprehension and numeracy (Marks and Ainley, 1996). 

These Longitudinal Surveys of Australian Youth have not had any direct connection with 
professional practice in schools. Rather, the research has had a clear connection with 
policy makers, and a direction which is not one-way. Policy makers have defined the 
research questions with which to come to the data and, increasingly, are playing a role in 
shaping the annual data collection in anticipation of their own subsequent policy 
questions. The new federal Minister is regularly commissioning analyses of the database 
to investigate policy options that he is exploring. 

Linking researchers with practitioners 

The third example is of action research in which professional practitioners and academic 
researchers are engaged as collaborators. It is a project sponsored by government and 
teachers’ unions and funded through a national professional development program. It is 
based on a view that professional development of teachers will be enhanced if they are 
enabled to reflect critically on their own professional practice. 

Action research aims to help practitioners investigate the connections between their own 
theories of education and their own day-to-day educational practices; and to integrate the 
research act into the educational setting so that it can play a direct and immediate role in 
the improvement of practice (Carr and Kemmis, 1986). 
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In action research, practitioners are encouraged to treat their own educational ideas and 
theories, their own work and work practices, and their own work settings as objects for 
analysis and critique. On the basis of careful reflection, they may uncover theoretical 
ideas which turn out to be unjustified, ways in which practices shaped by habit or 
tradition have become irrelevant, and how the settings in which they work place 
obstacles in the way of attaining educational goals. 

The particular project funded under the national professional development program 
operated under the descriptive title, Innovative Links between Universities and Schools 
for Teacher Professional Development. It has provided the opportunity for academic 
researchers in 14 universities to work in partnership with practising teachers on a whole- 
school basis in around 100 schools (Yeatman and Sachs, 1995). 

Sachs describes ways in which the research interests and perspectives of the university 
and school-based personnel are complementary and mutually supportive (Sachs, 1996). 
She points out that teachers are concerned primarily with understanding and improving 
practice and so have relatively context-specific interests. What they gain from the 
researchers is cross-contextual research information which enables them to situate then- 
reflective practice in a wider context. 

Academic analysts not only become directly acquainted with what it means to engage in 
continuous improvement in teaching and learning in a specific context, but become aware 
of what teachers regard as important and relevant and why. This helps to ensure that 
when academic communication is oriented toward practitioners it is informed about the 
needs and requirements of practitioners and practice settings. 

Academic research, on the other hand, is concerned with validity and generalisation and 
so is essentially cross-contextual, whether at a micro or macro level. While this research 
is not focused on doing and improving it is concerned with understanding the processes 
of action and improvement. Exposure to the day-to-day realities of school life through 
collaboration with professional practitioners seeking to reflect critically on their own 
practice in order to improve it enriched the academic researchers' own understanding of 
practice and tested the relevance of their cross-contextual information and theories. 

Participants reported through a formative evaluation that the relationship between 
teachers and academic associates was mutually beneficial when it was an equal 
relationship and best when the participants viewed each other as learners in the project 
(Yeatman and Sachs, 1995). With this approach the issue of dissemination is entirely 
redefined. There is no remote audience for research with whom effective communication 
must be established. There is collaboration on what the research questions are and on 
how to address them. There is divergence on the scope and level of generality of the 
conclusions sought, but neither is seeking an interpretation for the other to use. 

STRENGTHENING EDUCATIONAL RESEARCH AND DEVELOPMENT 

The analysis of the nature of educational research and development, the reviews of the 
educational research in Australia and the three varied examples all point to ways in which 
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the research enterprise might be strengthened. This will need to involve changes to the 
research enterprise itself and changes to the linkages between the research community on 
the one hand and the communities of policy makers and professional practitioners on the 
other. 

Changes in research effort 

Maintaining eclecticism 

One important message, from my point of view, is the need to maintain an eclectic 
approach. Paradigmatic or methodological hegemony will limit and stultify the research 
and development enterprise. The balance may well be shifting from 'natural science' to 
'interpretative' models of research, but there continues to be significant research of both a 
basic and applied kind in the natural science tradition which informs our understanding of 
educational processes and which can introduce and validate new practices. S Weller's 
work is an example. 

The review of the outcomes of the work of the 20 educational research teams funded 
between 1989 and 1993 under the Australian Research Council's Large Grant program 
found research fitting all three of the models outlined earlier, viz. 'natural science', 
'interpretative' and 'interventions and evaluations', as shown in Table 2 (McGaw et al., in 
press). 

Table 2: Distribution of funding by research model for each research team 



Team 


Natural 

Science 


Interpret 

ative 


Interv& 

evaluate 


Total 


Team 


Natural 

Science 


Interpret 
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Interv & 
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Total 


1 


215,000 






215,000 


11 




140,000 




140,000 


2 






210,000 


210,000 


12 


67,500 


67,500 




135,000 


3 


82,500 




117,500 


200,000 


13 


125,000 






125,000 


4 


95,000 




95,000 


190,000 


14 




110,000 




110,000 


5 




85,000 


85,000 


170,000 


15 


105,000 






105,000 


6 


160,000 






160,000 


16 




100,000 




100,000 


7 


150,000 






150,000 


17 


100,000 






100,000 


8 


75,000 


75,000 




150,000 


18 


90,000 






90,000 


9 


145,000 






145,000 


19 




80,000 




80,000 


10 


140,000 






140,000 


20 


80,000 






80,000 



The classification in Table 2 shows that the dominant model in the work of the research 
teams was the natural science model, with almost 60 per cent of all funding going to 
projects using this model. Research in the interpretative tradition attracted almost 25 per 
cent and intervention studies less than 20 per cent. 

This may, however, be an underestimate of the overall influence of the interpretative 
model in educational research. Several of the research teams reviewed shifted over the 
period from 1989 to 1993 toward more interpretative frameworks. Given general trends 
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in the social sciences, it is likely that increasing numbers of the best education scholars 
may make similar moves, perhaps bringing to interpretative research more use of 
quantitative methods than has been the case in the past. 

Concentrating effort 

A second, somewhat controversial, strategy would be to concentrate the research effort 
to some extent. This will permit more sustained work by those most likely to deliver but 
would, of course, be at the expense of others who might have hoped for support for at 
least some aspects of their work. 

In circumstances of limited resources for research, concentrating funding on fewer 
researchers rather than spreading it thinly will involve picking 'winners' in whose work to 
invest. It would be important then to have a rigorous evaluation of the outcomes of the 
funding so that resources can be redirected over time if performance does not justify 
continued support. 

Some research funding programs appear to offer renewal of funding on the basis of the 
quality of each round of applications for further funding, with little evidence of the 
results of previous funding other than self report in the next-round application. 

Building multidisciplinary teams 

The requirements of eclecticism and concentration of effort can be brought together in 
the development and funding of multidisciplinary teams to work on educational issues. 
Enriched understandings can come from the variety of substantive and methodological 
perspectives a multidisciplinary team can offer. 

There was some of this in the 20 teams whose work was reviewed in Australia. A team 
reviewing the development of youth policy over several decades consisted of a historian, 
a political scientist with research interests in social class and international social 
movements, and a researcher with a background in youth work and youth policy. A team 
concerned with mathematics learning consisted of a university mathematician and teacher 
and a cognitive psychologist. Other teams were more homogeneous, however, 
concentrating expertise and bringing the benefit of broader experience and a capacity to 
share in some ways more deeply than a multidisciplinary team. 

Improving links with policy making and practice 

If the unique feature of educational research is its engagement with a field of policy and 
professional practice, then work needs to be done to build and sustain good links 
between the research community and the communities of policy making and professional 
practice. 



84 

ERIC 



76 



Setting key agenda issues collaboratively 

One way to work at this is to have the research agenda set collaboratively. This can be 
done for the work of an individual team, as it is currently being done for the 
Longitudinal Surveys of Australian Youth, or it could be done in nominating some 
priorities areas within a national research enterprise or even in setting a national research 
agenda. 

A good example of the limited imposition of national priorities in the context of a 
research funding program which could accommodate other non-thematic work is 
provided by the Australian National Training Authority's national, competitive research 
funding program set up following the recommendations of the review of research on 
vocational education and training (McDonald et al., 1993). The priorities have been 
established by a group representative of all three communities. Substantial funding has 
been provided to establish a few centres focused on particular priority areas, some large 
projects have been funded in other priority areas and a variety of large and small projects 
have been funded in the priority areas as well as outside them. 

Establishing personnel exchanges 

Apart from active collaboration from different home bases, as in the Innovative Links 
Project bringing together school and university personnel to work on shared projects 
while maintaining their institutional affiliations, personnel exchange programs can build 
links in new ways between the separate communities. 

Building incentives for engagement with policy and practice 

Perhaps the most important thing to do in pursuit of collaboration is to build incentives 
which encourage it. The Australian National Training Authority Research Advisory 
Council gives priority in funding to project teams in which there will be genuine 
collaboration among team members from the different communities. That Council also 
ensured that its funding program was accepted as one of the competitive programs from 
which winning of grants brings additional research infrastructure funding to universities 
from the university funding agencies. 

More generally, work needs to be done to reduce the impact of the different interest and 
reward systems identified in Table I. Unless they are reoriented in some way, the 
interests of the different communities will not intersect and, worse, may even be in 
conflict. 
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Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 
Other Sources of Research. 

Bruce Chapman 1 Speaking Notes 

Two sets of material were prepared by Professor Chapman for the symposium. Part A is 
what he spoke to at the time, while Part B sets out some points which he felt might be 
helpful for the wider Impact Project. He stressed that he approached the issues under 
discussion as an economist, as an academic and with an interest in policy, but without 
having done much detailed research work on vocational education and training. He drew 
on his experience and sought to draw out common features, even though the subject 
matters were quite different: development of the Higher Education Contribution Scheme 
(HECS) and the Job Compact, a Federal Government initiative which provided a job 
guarantee for long-term unemployed people. (Editor’s note). 

PART A 

Practical Lessons Linking Research to Policy 

1. Make it simple to present: “their simplicity is their power”: 

(a) Long term unemployment projections: if the economy does badly, and the 
government did nothing, long term unemployment (LTU) would rise greatly. 
Even if the economy did reasonably well, LTU would not fall much. The 
projections demonstrated in the simplest way that LTU was a major problem. 

(b) Graduate relative salaries: a very simple picture which is reflected in virtually 
all advanced countries. A clear advantage: about $600-$700,000 extra 
earnings over the life cycle compared to non-graduates. 

2. Explicitly consider the distributional consequences: in economic terms one needs to 

consider who gains and who loses: 

(a) Who are the long term unemployed?: they tend to be the particularly 
disadvantaged groups and individuals. 

(b) Who goes to university? They are disproportionately from advantaged socio- 
economic backgrounds; while university graduates earn more than the 
average worker. If your father was in a professional or managerial 
occupation your chances of enrolling in higher education in the 1980’s were 
four times greater than if your father was in a less advantaged socio- 
economic occupation. If your parents were from an unskilled or semi-skilled 
background, 22% of the university cohort were from that background, 
whereas if the proportion equalled that in the population as a whole, it would 
have been about 50%. 
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3. Be sensitive to the budgetary implications. At present there are “fiscally 
parsimonious governments” throughout the OECD. They want to be seen as low 
tax, they want to be seen as low spend governments. 

(a) The job compact calculations were approximately revenue neutral overall. 
That debate within the process was quite important in the adoption of the 
policy, especially with Finance and Treasury. 

(b) With hypothecation of HECS revenue the extra funds were all to be used for 
growth in the higher education system. There were big queues for entry into 
higher education at the time. Hypothecation was important in relation to the 
politics of the public debate. Over 1989-95 the higher education system grew 
by about a third. 

4. Stress inherent fairness: 

(a) All taxpayers pay for university but only 15% attend. Is this fair? And 

students only had to repay the loan when they were earning above the 

average level of income. 

(b) The long term unemployed lose in a recession, but don’t gain in the recovery. 

PART B 

Practical Lessons from the Direct Policy Experience of a Researcher 

A. For researchers wanting to influence the policy process: 

(i) be very sure that your conclusions are correct; 

(ii) be aware of the broader politics, and be able to illustrate how the specific 

project fits into the bigger picture; 

(iii) be explicit about efficiency and distributional impacts; and 

(iv) take account of (or at least think about) the broad budgetary implications (ie. 
cost) of initiatives. 

B. For researchers directly involved in the policy process: 

(i) respect the skills and professionalism of senior bureaucrats - in many areas 
they will know much more than the consultant (ie. you); 

(ii) know the agenda of the Minister: 

• if it is consistent with research illustrate this in presentationally 
uncomplicated ways; 

• if it doesn’t seem correct in a research sense, point this out (in context); 

(iii) take notice of bureaucratic political matters (eg. Department of Social 
Security v Finance v Department of Employment, Education and Tr aining ); 

(iv) present material in ways such that people with no experience can understand 
the policy point; and 

(v) forget your ego. 



Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 
Other Sources of Research. 

Terri Seddon 1 Speaking Notes 



I will comment on the impact of research in VET from the perspective of someone who 
works between VET and the social science disciplines. This perspective is a 
consequence of my research on the restructuring of schools and TAFE (SOEP project) 
and the ‘Reshaping Australian Education’ project based at the Research School of Social 
Sciences at the Australian National University. This perspective is supplemented by 
insights derived from TAFE - University research partnerships and working with 
students completing doctoral studies in relation to VET. 

Section 2.4 in the paper which was circulated to participants prior to the symposium (see 
Appendix 1) makes the point that disciplines ‘influence the problems identified as 
important, the key questions posed and the techniques adopted to investigate them’. 

Disciplines are resources in research. They provide both cognitive and normative 
resources that enable the researcher to make a particular investigative cut through VET. 
They shape the approach of the researcher and the conduct of the research. It means 
that researchers working in different disciplinary frames bring entirely different ways of 
approaching and understanding the world to VET research and these different 
approaches offer distinct insights, perspectives and interpretations as resources to VET 
policy, planning and performance (eg. CEET/SOEP). 

In particular historical periods, some disciplinary resources are favoured over others. 
Currently, theories based on modelling the rational actor are the flavour of the month. 
Other disciplinary approaches do not disappear; they fall or are pressed out of view. 
When one approach is favoured while another is out of favour, it does not mean that 
either has any particular purchase on Truth. One is not right and the other wrong. 
Rather, they both offer different insights, but some of those insights are sought out, while 
others are disregarded. These processes play out as a result of the ongoing politics of 
knowledge within VET and between VET and other agencies. 

When a particular research approach is in favour, as particular forms of economics are 
now, they come to frame the research enterprise and policy, planning and performance in 
pervasive ways. Some topics get funded over others, some outcomes are preferred. 
This is what the document refers to as ‘ideas in good currency’. These ideas and ways of 
understanding come to be almost natural ‘good sense’. They conform with, and confirm, 
the commonsense ways of understanding amongst people working within the field. 

But policy, planning and performance is limited if ‘ideas in good currency’ come to 
colonise the whole of VET research. Such ideas are too comfortable. They do not 
challenge the orthodoxies. VET needs the insights derived from out-of-favour research 
approaches, because these insights are the ones that question the commonsense ways of 



1 Associate Professor in the Faculty of Education at Monash University. 



understanding and doing things. The out of favour approaches illuminate VET 
differently, highlighting unintended consequences and where problems exist, as well as 
the glimmer of innovative policy, planning and performance that can open up new 
opportunities and new solutions to problems. 

From where I stand, outside VET, it seems that for many people working in VET the 
sector is a self-referential universe. This is also evident in school education, but the VET 
universe is more orientated to industry than schools. It means that people working in 
VET focus their efforts on their work in VET. They are often autodidacts, learning from 
what they do through trial and error experiences and within the frames and meanings of 
their particular occupational cultures. The organisational and cultural frames of their 
occupation provide the major resources for making sense of what is going on, and for 
translating understandings into action. 

But alongside these people working in VET there are other groups of VET workers who 
do not take VET as their self-referential universe. Particular occupational frames and 
cultures are not their major reference points. Rather, their referential universes lie in 
communities beyond education: in disciplinary communities and in communities outside 
formal education and training provision (such as ethnic, professional or religious 
communities). For this group, VET is only a site for their broader community work. 
The occupational frames and cultures of VET do not provide the meanings which enable 
these educators to make sense of the world. Instead these educators draw resources 
from their primary referential communities in order to make sense of education. They 
maintain a critical distance on their work and focus their efforts by working on VET as 
well as in it. 

VET policy, planning and performance will be enriched if it can be informed by the 
insights of both groups. Those who work within the organisational and cultural frames 
of VET often speak with the voice of VET policy and planning, and these voices are 
often framed by the flavour of the month ‘ideas in good currency’. But those who work 
outside the organisational and cultural frames of VET (either identified in terms of 
discipline or wider communities) also provide useful resources. They pose questions that 
can clarify the taken-for-granted frames of reference of VET policy, planning and 
performance. They can also speak back to policy and planning, setting narratives about 
actual developments against heuristic or predictive modelling, or best guess orthodoxies. 

There is evidence that multiple perspectives on VET do exist and that there is some 
systemic support for the diversity of views. But the corporatisation of VET also presses 
in the other direction, disregarding the valuable research and interpretations of those who 
do not conform to the natural good sense of ‘ideas in good currency’. 

Following the symposium, reflecting back on it, she reaffirmed certain points: 

1. Research is a spectrum of practices that lead toward the production of meaning, 
understanding and knowledge. This knowledge production can occur on the basis 
of commonsense understanding; through reflection on action; through 
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sophisticated data collection and analysis; and through interpretations that are 
reflective about the conceptual resources drawn on and applied. 

What differentiates research from any old opinion forming are the conditions, 
resources and ethical principles that both constitute and constrain the knowledge 
production process. Conditions include, for example, the time available for 
research, the authority relations between researcher, researched and research 
funder. Resources for research are financial, organisational and conceptual. 
Ethical principles include, for example, commitments to disinterested investigation, 
to ‘telling it like it is’, to reflective conceptualisation and to the collective 
production of and access to knowledge. 

In these processes of knowledge production, the person ‘finding out and 
interpreting’ (ie. the researcher) is the critical technology. People choose then- 
tools to do carpentry - their hammers or screwdrivers - and these tools influence 
the kind of job that is done. Similarly in research, people choose researchers with 
different disciplinary and research capacities. These embodied skills and capacities 
shape the way research is done and the knowledge and understandings that are 
produced. The formation of a variety of differently constituted researchers is an 
important aspect in the development of research capacity in VET. It relates to the 
notion of creating human capital stock. 

Researchers make knowledge resources available to VET policy and practice. 
There are dangers when narrow orthodoxies develop, that curtail the speaking or 
hearing of a wide diversity of knowledge resources. It encourages narrowly based 
institutional design, limits the generation of future scenarios to which planning can 
be directed. 

The current commercialisation of research is changing relationships between 
policy, practice and research, and the relationships between policy makers, 
planners, practitioners and researchers. These changing relationships affect the 
processes of doing research and the processes of speaking about and hearing 
different knowledge resources (research products). The implications of these 
changing relationships need to be documented and assessed, so that unproductive 
stereotypes and divisions between policy makers, planners, practitioners and 
researchers do not obstruct sensible communication and debate. 

My sense is that currently blockages between research and policy and practice do 
exist, and exist particularly in relation to VET, because there is no well-established 
tradition of research in this field. One blockage is evident in the notion that only 
VET people should do VET research, and that more distanced researchers have 
nothing to offer. These unproductive stereotypes are based on associations 
between research and organisational relationships. 

There is a strong view that VET researchers should be in CORPORATE relations 
with VET, ie. subject to those who resource and commission research, providing 
the answers that VET wants. 



There is a counter view, evident perhaps most strongly amongst some researchers, 
that research should be independent of VET, telling truths rather than 
predetermined answers. This is sometimes read as a CONFRONTATIONIST 
model in which VET and researchers are opposed. 

Yet more sensible than both, is a COOPERATIVE (or, perhaps, 
CONTRACTUAL) model in which VET and researchers are recognised as being 
different parties to a common project of enhancing VET policy, pl annin g and 
practice. The relationships would vary depending on the work done (e.g. from 
reflective practice in VET to independent research), but the conditions, resources 
and ethics of each party would be recognised and respected within the terms of the 
negotiated arrangement between the parties. This model offers scope for 
generating diverse research outcomes that can be used to inform debates about 
VET reform. 

7. For the cooperative (contractual) model to work, requires VET policy makers and 
practitioners to have an understanding of the distinctive character of research as 
wort, a sense of its difficulties and limits, and of the way research questions 
generate many answers and many more questions. Education of the receiver (and 
commissioner) of the research is as important as education of the researcher. 

8. This cooperative model also requires special attention to the development of 
organised translation mechanisms between the different discursive communities 
centred on VET. This is partly a matter of dissemination (as noted at the 
symposium), but it is also a more generalised process that puts a priority on the 
productive use of discursive dissonance and developing the skills and capacities for 
hearing and speaking across cultures. 
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Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 

Other Sources of Research. 

Fran Thorn 1 Spoken Comments 

Consultants and researchers are now less distinct than they used to be. The big six 
accounting firms are relatively recent players in the policy making process. However, 
they are a growing force (KPMG has 1,200 staff in its Melbourne office alone), in policy 
making, in research, in the provision of advice to governments in general (and on VET in 
particular). One reason is the downsizing of the public sector: what was public is now 
private. Governments appear to be increasingly looking for alternative sources of advice, 
perhaps because of distrust of the traditional sources. They do tend to want the advice 
urgently. 

There are a range of categories of research. KPMG does not tend to be called on for 
traditional research. They tend, rather, to be called on to solve problems, to do so 
quickly and not to be smarter than the client. Governments tend to overspecify the 
methodology, but do underspecify the questions to be investigated. Clients tend to be 
looking for speed rather than reflection; to help the policy happen. There appears to be 
scope for consultants to expand their role in relation to evaluation studies in VET. They 
help decision makers modify and redirect both policy and practice. The work of 
consultants tends to be more breadth than depth; they often synthesis research rather 
than undertake original studies; it is highly focussed on providing relevant results to the 
client promptly and in a useable form; and it can be tricky to put forward views that the 
evidence suggests, but that the client may not really want to hear. 

With particular regard to VET, there is a small group of policy makers, who tend to 
think training is the centre of the universe. They are often a bit anti-intellectual; a bit 
insecure about the sector’s valuable role for many Australians; often not interested in 
hearing bad news; and tend to believe their own rhetoric. Overall, they inhabit a 
contested domain; they tend to be looking for solutions, not policy or research; and they 
often want answers, not more research questions. 
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Session 4 Research and Researchers’ Perspectives: From the Viewpoint of 
Other Sources of Research. 

Other Matters Raised in the Discussion Period 



Among the additional matters raised in the discussion period, which was relatively short 
at the end of the day, three are set out below. First, it was noted that the distinctions 
between the sectors of education were tending to become more blurred. In NSW Perce 
Butterworth noted that there were some 35,000 school students studying VET subjects; 
collaboration between VET providers and higher education institutions was also 
increasing. Some scepticism was expressed about the growing interest in VET by 
university researchers, but others noted that this was in line with national policies and 
responding often to explicit incentives. 

Secondly, it was stressed that information was only one factor influencing decisions (and 
that research was only one source of information for decision makers). For example, one 
speaker argued that the Howard Government abolished the Job Compact arrangements 
“because they were ideologically against this approach: research had nothing to do with 
it. If the Keating Government had been re-elected, the arrangements would still be in 
existence”. 

Thirdly, the importance of individual champions or patrons was noted, both in the 
research system and in the decision making system. Don Anderson argued that the 
change in Minister significantly downgraded the chance of the inquiry’s findings in 
relation to post-secondary education in Victoria being implemented, whether based on 
research or not. Continuity at the political level would probably have increased the 
chance of research impact in this case; on the other hand changes in governments. 
Ministers and their senior bureaucrats could open the doors to some research, while 
closing it on others. 
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Session 5 Community Relations: Researchers’ Contribution to Facilitating 
Interactions Between Wider Economic, Political and Societal 
Systems and VET. 

David Corbett 1 Speaking Notes 

The impact of research on policy may be indirect. Research may produce or reinvent an 
idea, the idea may spread into the community and become popular, and then the policy 
elites may take it up and produce policies and programs based on it. 

The media play a role in spreading an idea and making it popular. Media reports of 
research findings are rare, however. It is more likely that a research idea will have been 
promoted by a keen research publicist - a “product champion”. Such a person may find 
patrons in a specialised interest group or promotional organisation. He or she may find a 
patron in the policy elite, but that may only happen after the idea has gained currency in 
the community. 

What is under examination in this symposium are questions such as “Where do policies 
come from?”; and “What part does research play?” There is a political science literature 
on this topic. Within this literature several themes are developed, a certain amount of 
agreement exists, but also differences of emphasis and some outright disagreements. The 
topic of agenda-setting is also dealt with in sociology, with which political science often 
overlaps . 2 



1 Visiting Fellow, Centre for Public Policy, The University of Melbourne. 

2 For example, see the 1996 book. Agenda for Excellence 2, a collection of studies in honour of 

Professor Charles Levine, edited by B. Guy Peters and Bert A. Rockman, two well-known American 
writers on public policy and public administration. The chapter by H. Brinton Milward and Wendy 
Laird contains a review of the agenda-setting literature; also included in the notes are references to 
many of the outstanding contributions. 
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Session 5 Community Relations: Researchers’ Contribution to Facilitating 
Interactions Between Wider Economic, Political and Societal 
Systems and VET. 

Steve Balzary 1 Speaking Notes 



1. Australian Chamber of Commerce and Industry’s Mission Statement: 

‘To further the interests of its members and the Australian community by 
formulating and effectively promoting policies which create a growing and 
responsible private sector’. 

Note: (i) ACCI works through its structures, sees its prime role as to represent 
employers and engages in extensive consultation. 

(ii) ACCI is not just an industrial relations body. It undertakes a range of 
work of interest to its members, including about eighty people who are 
involved in education and training matters. This is seen as part of the 
organisation’s mainstream activities. 



2. ACCI - structure and roles 



ACCI 



40 MEMBER 
ORGANISATIONS 
* STATE/TERRITORY 
• INDUSTRY 



350,000 EMPLOYERS 

TOP 100 COMPANIES 

OVER 55,000 ENTERPRISES: 20-100 EMPLOYERS 
OVER 280,000 ENTERPRISES: LESS THAN 20 EMPLOYERS'' 



3. Research’s contribution to facilitating interaction between wider systems and 
VET 

• ‘Employer led’ approach to ‘consultation with industry’: 

- ACCI wants a major, even leading, role for employers as the key stakeholder in 
relation to VET. 



1 Office of the Australian Chamber of Commerce and Industry, Canberra. 
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- The ‘employer led’ approach to VET is being whittled away; to ACCI ‘employer 
led’ applies to everything relating to VET; particularly focusing on the needs of 
small and medium sized enterprises. 

- Employers are interested in what benefits they can derive from VET and in the 
bottom line. 

• Employer organisations as initiators of research: 

- There is a lot of research going which is of no interest at all to employers. 

- There is a mass of paper, but to be read by employers it needs to be short and 
concise. 

- Member employer organisations rely on ACCI and government agency staff to 
distil the relevant points from research for them. 

- ACCI obtained $30,000 from ANTA to conduct consultations (in relation to VET 
in schools). This is a value added product, which is helping to bring employers 
along with the process. We will own the outcomes. 

• Consultant led recoveries: 

- Very heavy demands on ACCI staff and members. Currently some 25 research 
projects directly affecting employers in the VET sector. 

- Employers are increasingly unwilling to participate; and not turning up or 
participating. This is a problem for employer organisations as well as for 
researchers. 

- ACCI is trying to focus on issues of particular importance to employers; but other 
issues can be important and the issues are often inter-related. 

• Relevance / distribution of findings to all stakeholders: 

- In writing reports it is important to target particular audiences. This is a major 
challenge and it is often not well done. 

- Yet training and related matters are critical for productivity performance. 

4. In conclusion 

• Employers see VET as important, including traineeships and apprenticeships. 

• Inter-action between firms and VET is difficult; it is a particular problem for many 

small and medium sized firms. 
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